00000400:00080000:2.0F:1782361985.558995:0:35449:0:(debug.c:457:libcfs_run_debug_log_upcall()) Invoked LNET debug log upcall /usr/lib/lustre/lnet_debug_log_upcall /tmp/lustre-log.1782361985.35012
00010000:02000000:0.0F:1782361985.559029:0:35012:0:(ldlm_lib.c:1855:target_finish_recovery()) lustre-MDT0000: Recovery over after 3:00, of 1 clients 0 recovered and 1 was evicted.
00000004:00000080:1.0F:1782361985.571387:0:35012:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffacdd82f03e10
00100000:10000000:1.0:1782361985.571420:0:35012:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread
00000004:00080000:2.0:1782361985.571741:0:34998:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x1ca:0x0]
00000004:00080000:3.0F:1782361985.571749:0:35001:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x1ca:0x0]
00000100:00100000:2.0:1782361985.571797:0:34998:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5102d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34998:1868940992354048:0@lo:5:osp-pre-0-0.0
00000100:00100000:3.0:1782361985.571800:0:35001:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35001:1868940992354176:0@lo:5:osp-pre-1-0.0
00000100:00100000:2.0:1782361985.571889:0:34998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1782361985.571920:0:35001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1782361985.571949:0:14579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992354048
00000100:00100000:2.0:1782361985.571956:0:14579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992354048
00000100:00100000:3.0:1782361985.571972:0:35001:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5078356c0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.571985:0:6591:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992354176
00000100:00100000:3.0:1782361985.571988:0:34998:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ceaa540 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.571991:0:6591:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992354176
00000100:00100000:2.0:1782361985.572013:0:14579:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 499
00000100:00080000:3.0:1782361985.572014:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:3.0:1782361985.572021:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:2.0:1782361985.572026:0:14579:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5102da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:34998:x1868940992354048:12345-0@lo:5:osp-pre-0-0.0
00000100:00100000:0.0:1782361985.572033:0:6591:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500
00000100:00100000:0.0:1782361985.572040:0:6591:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5047f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:35001:x1868940992354176:12345-0@lo:5:osp-pre-1-0.0
00002000:00080000:0.0:1782361985.572055:0:6591:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 577 -> diff = -119
00002000:02000040:0.0:1782361985.572059:0:6591:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:459 to 0x280000400:577)
00002000:00080000:3.0:1782361985.572072:0:14579:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 577 -> diff = -119
00002000:02000040:3.0:1782361985.572076:0:14579:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:459 to 0x240000400:577)
00002000:00010000:0.0:1782361985.576027:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.576040:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576055:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x241:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.576059:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x241:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.576065:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576079:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576088:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576095:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576115:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.576130:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.576137:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576144:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7b800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.576148:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576155:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576169:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576174:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003677ffb4/0x57e58d5a90c7e784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576187:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.576188:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.576199:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.576561:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.576567:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576580:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.576583:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x240:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.576587:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576595:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576602:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576609:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576626:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.576641:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.576645:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576652:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7ae00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.576656:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576664:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576675:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576683:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f3487c4d/0x57e58d5a90c7e78b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.576696:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.576698:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.576704:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.576947:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.576953:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576961:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23f:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.576964:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.576968:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576977:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.576996:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577002:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577018:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.577038:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.577046:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577056:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7b000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.577059:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577068:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577080:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577088:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000340b12ad/0x57e58d5a90c7e792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577103:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.577105:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.577107:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.577250:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.577255:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577263:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23e:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.577266:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.577270:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577279:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577286:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577294:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577323:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.577339:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.577343:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577349:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7aa00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.577351:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577366:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577374:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577379:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073c93588/0x57e58d5a90c7e799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.577391:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.577392:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.577394:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.577591:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.577595:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577600:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23d:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.577602:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.577605:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577610:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577615:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577619:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577631:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.577652:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.577657:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577663:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7bc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.577665:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577679:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577687:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577692:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca8052aa/0x57e58d5a90c7e7a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577704:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.577706:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.577709:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.577880:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.577886:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577893:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23c:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.577902:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.577906:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577915:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577922:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577929:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.577945:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.577964:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.577970:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577979:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7b600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.577983:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.577990:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578009:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578029:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9eabc11/0x57e58d5a90c7e7a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578047:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.578050:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.578053:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.578156:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.578160:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578165:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23b:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.578167:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.578169:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578175:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578180:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578188:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578202:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.578227:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.578232:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578251:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408e7ac00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.578255:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578262:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578273:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578292:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008ecc5e3b/0x57e58d5a90c7e7ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578306:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.578308:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.578311:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.578415:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.578419:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578424:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.578426:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x23a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.578428:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578435:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578443:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578450:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578466:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.578491:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.578497:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578505:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e508a9f400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.578509:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578517:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578528:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578535:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e6fd9a6a/0x57e58d5a90c7e7b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.578552:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.578555:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.578558:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.578691:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.578695:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578704:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x239:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.578706:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x239:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.578709:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578714:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578719:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578724:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.578735:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.578753:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.578758:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578764:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e508a9fc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.578767:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578773:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578780:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578784:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000db5fbd24/0x57e58d5a90c7e7bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.578804:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.578805:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.578806:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.579024:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.579028:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579033:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x238:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.579035:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x238:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.579038:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579043:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579056:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579060:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579073:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.579097:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.579103:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579112:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd9000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.579116:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579124:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579138:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579143:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071ebc23d/0x57e58d5a90c7e7c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579156:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.579157:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.579158:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.579325:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.579329:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579337:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x237:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.579340:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x237:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.579344:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579352:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579360:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579367:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579393:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.579409:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.579414:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579423:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd8c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.579427:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579433:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1782361985.579434:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x241:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.579447:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579448:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579467:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f5bf6a/0x57e58d5a90c7e7ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.579470:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x241:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.579475:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x241:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1782361985.579477:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.579479:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.579481:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579481:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.579497:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.579503:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.579508:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.579521:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.579533:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.579538:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579543:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.579546:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579561:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579574:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579582:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7e7d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x241:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.579600:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.579602:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.579606:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.579785:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.579804:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579812:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x236:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.579815:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x236:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.579819:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579826:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579850:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579858:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.579872:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.579939:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.579945:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579954:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd9a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.579958:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579980:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579990:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.579995:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b78ea54a/0x57e58d5a90c7e7d8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580006:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580007:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580009:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.580011:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x240:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.580019:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580028:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x240:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.580031:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x240:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.580036:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580047:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580055:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580060:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580073:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.580094:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.580100:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580107:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.580110:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580116:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580136:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580154:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7e7df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x240:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580173:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580175:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580177:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.580251:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.580259:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580267:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x235:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.580275:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x235:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.580280:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580290:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580300:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580307:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580328:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.580347:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.580352:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580363:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd8000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.580366:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580372:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580381:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580394:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005297b179/0x57e58d5a90c7e7e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580406:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.580407:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.580410:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.580453:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.580460:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580468:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23f:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.580472:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23f:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.580476:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580498:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580507:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580514:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580534:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.580557:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.580563:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580571:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.580575:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580591:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580603:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580611:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7e7ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.580624:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.580626:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.580635:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.580691:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.580697:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580705:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x234:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.580709:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x234:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.580713:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580722:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580730:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580744:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.580762:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.580781:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.580785:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580803:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd8600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.580806:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580812:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580822:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580855:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000048a0db1/0x57e58d5a90c7e7f4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.580874:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580877:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.580890:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.580948:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.580955:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580964:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.580967:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23e:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.580971:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580982:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.580990:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581009:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581029:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.581054:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.581060:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581069:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.581073:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581082:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581093:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581099:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f8d2af8/0x57e58d5a90c7e7fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581114:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581121:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581123:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.581185:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.581189:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581195:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x233:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.581197:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x233:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.581199:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581206:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581211:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581216:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581231:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.581250:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.581255:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581264:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd8200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.581269:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581278:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581295:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581303:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045d7995f/0x57e58d5a90c7e802 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581317:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.581319:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.581321:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.581517:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.581524:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581533:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23d:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.581536:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23d:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.581540:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581549:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581558:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581566:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.581585:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00002000:00010000:0.0:1782361985.581606:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.581613:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581615:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.581622:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581633:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:1.0:1782361985.581637:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.581638:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x232:0x0].0x0 since=0s v=(0 0)
00010000:00010000:1.0:1782361985.581647:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581647:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581671:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581694:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581703:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581704:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581733:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.581734:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.581745:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7e809 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581755:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.581761:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581765:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581770:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd9c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.581770:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581775:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.581775:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581803:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581813:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581818:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055aac047/0x57e58d5a90c7e810 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.581846:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581848:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.581849:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.581992:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.581999:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582013:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23c:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.582017:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23c:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.582022:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582031:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582040:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582048:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582065:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.582088:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00002000:00010000:0.0:1782361985.582093:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:2.0:1782361985.582096:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582099:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582113:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.582116:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x231:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:2.0:1782361985.582118:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582121:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x231:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.582131:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582134:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582148:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582153:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582180:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7e817 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582182:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582194:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582196:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582199:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582202:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.582221:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.582259:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.582266:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582275:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd8a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.582279:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582288:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582300:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582321:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006234e8e5/0x57e58d5a90c7e81e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582341:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.582343:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.582346:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.582418:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.582425:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582433:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23b:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.582436:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23b:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.582441:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582450:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582467:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582472:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582486:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.582509:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.582516:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582533:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.582538:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582548:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582561:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582568:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7e825 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582587:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.582590:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.582599:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:0.0:1782361985.582613:0:6591:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:0.0:1782361985.582618:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582624:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x230:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:0.0:1782361985.582626:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x230:0x0].0x0 since=0s v=(0 0)
00010000:00010000:0.0:1782361985.582630:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582640:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582648:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582655:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.582685:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.582715:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.582721:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582729:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd9400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.582734:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582742:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582755:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582762:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000059d268ac/0x57e58d5a90c7e82c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1782361985.582764:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x23a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.582771:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582778:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.582780:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x23a:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.582783:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582784:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582800:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.582806:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582810:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.582814:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582820:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.582881:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.582893:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.582901:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.582902:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582914:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.582918:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582928:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582941:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582949:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7e833 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x23a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.582967:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582969:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.582972:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.583065:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.583082:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 120 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.583091:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22f:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.583094:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.583098:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.583140:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 120 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.583155:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 120 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00010000:3.0:1782361985.583158:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x239:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.583168:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.583178:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354304:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.583179:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x239:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.583186:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x239:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.583190:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583200:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583208:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583216:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583235:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.583267:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.583273:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583282:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00000100:00100000:0.0:1782361985.583285:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed346c0 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.583286:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583296:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583310:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583318:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7e841 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x239:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583335:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.583338:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.583340:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.583547:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x238:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.583551:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583556:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x238:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.583562:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x238:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.583564:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583570:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583576:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583580:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583591:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.583612:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.583617:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.583634:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.583637:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.583654:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.583664:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.583672:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e848 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x238:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.583685:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.583687:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.583688:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.583825:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x237:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.583856:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583865:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.583868:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x237:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.583873:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583883:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583892:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583905:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.583921:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.583936:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.583942:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583951:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.583955:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583971:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583982:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.583990:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001b94276a/0x57e58d5a90c7e84f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x237:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584004:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.584006:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.584008:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.584193:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x236:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.584199:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584207:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x236:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.584209:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x236:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.584213:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584221:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584229:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584236:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584255:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.584284:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.584291:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584301:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cec00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.584304:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584313:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584324:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584342:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e856 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x236:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584359:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.584361:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.584363:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.584535:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x235:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.584541:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584553:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.584556:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x235:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.584559:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584568:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584575:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584581:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584600:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.584619:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.584624:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584631:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfe00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.584633:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584639:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584647:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584660:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e85d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x235:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.584670:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.584671:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.584672:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.584885:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x234:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.584889:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584894:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x234:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.584896:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x234:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.584899:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584904:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584916:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584920:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.584932:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.584954:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.584960:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584967:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.584969:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584975:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584983:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584987:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e864 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x234:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.584996:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.584997:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.585004:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.585147:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x233:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.585152:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585159:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x233:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.585162:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x233:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.585166:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585176:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585184:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585192:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585217:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.585237:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.585242:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.585248:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cea00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.585251:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.585256:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.585267:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.585275:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7e86b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x233:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.585288:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.585290:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.585298:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.585555:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x232:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.585560:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585568:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x232:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.585571:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x232:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.585574:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585580:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585585:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585589:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585606:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.585818:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.585822:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.585839:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.585841:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.585846:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.585854:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.585859:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e872 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x232:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.585868:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.585870:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.585871:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.585964:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x231:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.585969:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.585977:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x231:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.585986:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x231:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.585991:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586000:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586007:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586015:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586031:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.586057:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.586064:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.586072:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.586075:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.586081:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.586088:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.586092:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e879 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x231:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.586101:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.586102:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.586103:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00002000:00010000:3.0:1782361985.586299:0:14579:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x230:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1
00010000:00010000:3.0:1782361985.586305:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586314:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x230:0x0].0x0 since=1054s v=(0 0)
00010000:00010000:3.0:1782361985.586317:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x230:0x0].0x0 since=0s v=(0 0)
00010000:00010000:3.0:1782361985.586321:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586328:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586333:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586342:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586356:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.586378:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.586386:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.586395:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.586399:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.586419:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.586430:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.586438:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7e880 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x230:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.586452:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.586454:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.586457:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.586577:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586589:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 120 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586593:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22f:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.586595:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.586597:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586620:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 120 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.586629:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 120 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.586642:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992354432:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.586712:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835c00 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.587243:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.587266:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354304:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.587289:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.587300:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112192
00000100:00100000:3.0:1782361985.587306:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112192
00010000:00010000:3.0:1782361985.587366:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 121 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.587395:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 59
00000100:00100000:3.0:1782361985.587401:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+121:2365:x1868940985112192:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.587411:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.587417:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 121 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.587429:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 121 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.587446:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9701b75/0x57e58d5a90c7e3b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31dc expref: 121 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.587457:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.587460:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.587465:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.587471:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.587492:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.587517:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+120:2365:x1868940985112192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 115us (276us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.587525:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 59
00010000:00010000:0.0:1782361985.587581:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.587588:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.587594:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.587599:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.587611:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.587640:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.587645:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.587651:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408cd9e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.587653:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.587665:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.587673:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.587678:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d98b418a/0x57e58d5a90c7e83a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.587690:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.587691:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.587692:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.587999:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.588008:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 119 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.588013:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22e:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.588015:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.588017:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.588030:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 119 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.588041:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 119 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.588049:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354560:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.588082:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.588365:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992354432:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.588379:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.588903:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354560:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.588922:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.589089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.589128:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112320
00000100:00100000:1.0:1782361985.589135:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112320
00000100:00100000:2.0:1782361985.589140:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.589160:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 121 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.589187:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112448
00000100:00100000:1.0:1782361985.589191:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112448
00000100:00100000:2.0:1782361985.589197:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 60
00010000:00010000:1.0:1782361985.589206:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 120 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.589211:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5102d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+121:2364:x1868940985112320:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.589227:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.589235:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 121 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589251:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 121 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.589255:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 61
00000100:00100000:1.0:1782361985.589271:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+120:2365:x1868940985112448:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.589280:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.589282:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ec2194e/0x57e58d5a90c7e37f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31c7 expref: 121 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589293:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 120 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589314:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 120 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589319:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.589324:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.589327:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000000b4a8f/0x57e58d5a90c7e347 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb31b2 expref: 120 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589330:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589337:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.589342:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589342:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.589348:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589360:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589376:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.589381:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.589413:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5102d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+120:2364:x1868940985112320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 204us (328us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.589413:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f76c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+119:2365:x1868940985112448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 147us (271us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.589429:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.589434:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 60
00010000:00010000:3.0:1782361985.589435:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.589458:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.589461:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 61
00010000:00010000:3.0:1782361985.589462:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.589493:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.589499:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.589522:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.589529:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.589549:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1782361985.589557:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.589560:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1782361985.589568:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589579:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.589584:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.589585:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589593:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589597:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589613:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.589620:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589628:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589646:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589671:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e88e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589676:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.589685:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e887 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.589687:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.589691:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.589694:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.589706:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.589709:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.589712:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.590066:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.590085:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 118 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.590090:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22d:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.590092:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.590094:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.590114:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 118 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.590129:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 118 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.590140:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354688:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.590208:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed34cc0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.590282:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.590303:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 119 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.590312:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22e:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.590317:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.590321:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.590476:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 119 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.590486:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 119 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.590497:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992354816:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.590560:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835600 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.591472:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354688:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.591489:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.592272:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.592315:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.592362:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112576
00000100:00100000:1.0:1782361985.592370:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112576
00000100:00100000:0.0:1782361985.592384:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112704
00000100:00100000:0.0:1782361985.592390:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112704
00010000:00010000:1.0:1782361985.592408:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 119 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.592416:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992354816:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.592416:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 120 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.592455:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.592548:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 62
00000100:00100000:0.0:1782361985.592558:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 63
00000100:00100000:1.0:1782361985.592563:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5102db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+119:2364:x1868940985112576:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.592571:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5102d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+120:2364:x1868940985112704:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.592589:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.592589:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.592599:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 120 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592601:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 119 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592622:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 120 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592628:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 119 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592640:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ebe80ce6/0x57e58d5a90c7e30f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb319d expref: 120 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592661:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.592665:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.592668:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592674:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000083e6ccb/0x57e58d5a90c7e2d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3188 expref: 119 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592676:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592708:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.592712:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.592718:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.592722:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592724:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.592748:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.592750:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5102d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+119:2364:x1868940985112704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 177us (427us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.592781:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592782:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.592800:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 63
00010000:00010000:3.0:1782361985.592851:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.592886:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.592911:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.592928:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5102db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+118:2364:x1868940985112576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 360us (648us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.592958:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.592962:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 62
00010000:00010000:3.0:1782361985.592964:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.592973:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.592981:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.592982:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.592991:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.592992:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.592995:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.593004:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.593010:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.593018:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593023:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.593026:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7e89c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593032:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593049:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.593055:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593067:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.593070:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.593075:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.593080:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.593098:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593108:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e895 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.593128:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.593130:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.593132:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.593640:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.593653:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 117 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.593658:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22c:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.593660:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.593663:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.593690:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 117 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.593708:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 117 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.593720:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354944:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.593722:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.593743:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 118 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.593752:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22d:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.593757:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.593762:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.593769:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.593800:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 118 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.593811:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 118 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.593822:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355072:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.593997:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.595119:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992354944:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.595140:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.595581:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.595633:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112832
00000100:00100000:1.0:1782361985.595640:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112832
00010000:00010000:1.0:1782361985.595669:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 118 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.595696:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.595746:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355072:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.595767:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985112960
00010000:00010000:3.0:1782361985.595770:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.595774:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985112960
00000100:00100000:2.0:1782361985.595798:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 64
00010000:00010000:1.0:1782361985.595815:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 119 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.595818:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5102d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+118:2364:x1868940985112832:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.595879:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.595889:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 118 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.595901:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 65
00010000:00010000:2.0:1782361985.595906:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 118 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.595917:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e505cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+119:2364:x1868940985112960:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.595928:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.595932:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dc12b93c/0x57e58d5a90c7e267 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb315e expref: 118 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.595937:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 119 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.595950:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.595955:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.595959:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 119 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.595962:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.595972:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.595995:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000023cd3d6/0x57e58d5a90c7e29f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3173 expref: 119 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596009:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.596013:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.596018:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596023:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.596027:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.596052:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596057:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.596067:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5102d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+117:2364:x1868940985112832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 257us (486us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.596070:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.596080:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 64
00000100:00100000:1.0:1782361985.596093:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e505cad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+118:2364:x1868940985112960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 176us (395us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.596096:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.596110:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 65
00010000:00010000:3.0:1782361985.596115:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.596141:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.596142:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596157:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596167:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596175:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596200:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.596203:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1782361985.596213:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596216:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.596224:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596226:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.596237:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.596239:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596243:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596257:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596260:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596284:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596293:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000013281893/0x57e58d5a90c7e8a3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596300:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.596309:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7e8aa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.596311:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.596314:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.596318:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.596333:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.596336:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.596338:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.597017:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.597019:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.597070:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 116 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.597070:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 117 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.597116:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22b:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.597130:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.597142:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.597147:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22c:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.597162:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.597169:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.597199:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 116 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.597204:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 117 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.597225:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 117 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.597233:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 116 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.597252:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355328:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.597260:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355200:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.597323:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.597331:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835cc0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.598508:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355328:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.598523:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355200:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.598530:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.598543:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.600035:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.600078:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113088
00000100:00100000:2.0:1782361985.600085:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.600088:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113088
00010000:00010000:1.0:1782361985.600128:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 117 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.600160:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113216
00000100:00100000:1.0:1782361985.600164:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113216
00000100:00100000:3.0:1782361985.600175:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 66
00000100:00100000:3.0:1782361985.600189:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+117:2364:x1868940985113088:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.600196:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 118 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600206:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.600214:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 117 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600229:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 117 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.600231:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 67
00000100:00100000:1.0:1782361985.600244:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+118:2365:x1868940985113216:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.600256:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec65277c/0x57e58d5a90c7e1f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3134 expref: 117 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600256:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.600264:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 118 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600277:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.600280:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 118 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600283:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.600298:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600298:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a3f68aac/0x57e58d5a90c7e22f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3149 expref: 118 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600324:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600325:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.600333:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.600341:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600351:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.600365:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.600376:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.600401:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.600402:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.600422:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+116:2364:x1868940985113088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 234us (388us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.600423:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+117:2365:x1868940985113216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 179us (335us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.600425:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.600438:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600442:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.600443:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 66
00010000:00010000:2.0:1782361985.600454:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.600473:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.600475:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 67
00010000:00010000:0.0:1782361985.600485:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600493:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.600506:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.600509:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.600515:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.600516:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600523:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600528:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7ac00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.600535:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600537:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.600545:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600549:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600562:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600570:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600578:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.600593:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e8b1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600599:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006bb53d66/0x57e58d5a90c7e8b8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.600617:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.600619:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.600620:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.600627:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.600631:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.600633:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.601065:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.601091:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 115 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.601095:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.601101:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22a:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.601109:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.601115:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.601118:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 116 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.601133:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22b:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.601137:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.601141:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.601148:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 115 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.601159:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 115 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.601168:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 116 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.601170:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355456:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.601186:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 116 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.601213:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355584:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.601220:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed346c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.601248:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835cc0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.602260:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f4a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355584:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.602281:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.603823:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.603865:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355456:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.603883:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113344
00010000:00010000:0.0:1782361985.603885:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.603890:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113344
00000100:00100000:3.0:1782361985.603906:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.603924:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 116 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.603931:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113472
00000100:00100000:0.0:1782361985.603937:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113472
00010000:00010000:0.0:1782361985.603956:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 117 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.603969:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 68
00000100:00100000:2.0:1782361985.603985:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+116:2365:x1868940985113344:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.603999:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1782361985.604003:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 69
00010000:00010000:2.0:1782361985.604009:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 116 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.604018:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+117:2364:x1868940985113472:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.604026:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 116 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604032:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.604039:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 117 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604049:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a76652fc/0x57e58d5a90c7e187 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb310a expref: 116 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604055:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 117 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604071:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.604077:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.604077:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e1bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb311f expref: 117 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604086:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.604090:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.604091:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604093:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604109:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604113:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604130:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.604140:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.604147:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604157:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604166:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.604172:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+116:2364:x1868940985113472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 158us (266us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.604175:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.604179:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f77050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+115:2365:x1868940985113344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 194us (354us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.604184:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 69
00010000:00010000:1.0:1782361985.604188:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604198:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.604201:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 68
00010000:00010000:1.0:1782361985.604201:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604221:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604227:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604239:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1782361985.604252:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.604258:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604266:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.604271:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604274:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.604281:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604288:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.604290:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604292:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604312:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604321:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604323:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604344:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7e8bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.604345:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7e8c6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.604377:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.604378:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.604379:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.604380:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.604388:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.604391:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.604683:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604683:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604699:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 114 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604706:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 115 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604706:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x229:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.604709:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.604713:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x22a:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.604713:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604716:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.604720:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604738:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 115 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604738:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 114 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.604750:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 115 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.604751:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 114 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.604764:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355712:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.604764:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355840:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.604825:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835180 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.604825:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed346c0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.605715:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992355840:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.605727:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.605748:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355712:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.605763:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.606735:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.606765:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.606940:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113728
00000100:00100000:3.0:1782361985.606941:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113600
00000100:00100000:1.0:1782361985.606947:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113728
00000100:00100000:3.0:1782361985.606948:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113600
00010000:00010000:3.0:1782361985.606981:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 115 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.606982:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 116 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.607029:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 70
00000100:00100000:1.0:1782361985.607041:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 71
00000100:00100000:3.0:1782361985.607047:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+115:2364:x1868940985113600:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.607055:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+116:2365:x1868940985113728:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.607062:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.607070:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.607079:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 116 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607081:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 115 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607103:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 116 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607108:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 115 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607134:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000089c0b62f/0x57e58d5a90c7e117 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30e0 expref: 115 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607135:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b6f8460d/0x57e58d5a90c7e14f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30f5 expref: 116 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607160:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.607163:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x22a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.607166:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607170:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.607179:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.607186:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607190:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607204:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607221:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.607228:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.607254:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.607259:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.607265:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+115:2365:x1868940985113728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 214us (529us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.607270:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+114:2364:x1868940985113600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 228us (502us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.607287:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.607287:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 71
00010000:00010000:0.0:1782361985.607290:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.607299:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 70
00010000:00010000:2.0:1782361985.607312:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.607314:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.607332:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.607335:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.607370:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.607376:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1782361985.607389:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.607397:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607405:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.607410:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607420:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607434:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607442:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e8d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607474:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.607484:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.607493:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.607504:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.607508:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607517:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607528:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607533:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e8cd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x22a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.607548:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.607550:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.607551:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.608021:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.608023:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.608046:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 114 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.608050:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 113 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.608055:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x229:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.608061:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.608065:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x228:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.608066:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.608072:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.608077:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 4/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.608116:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 114 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.608117:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 113 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.608133:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 113 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.608141:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 114 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.608166:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355968:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.608169:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356096:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.608230:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea900 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.608231:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed34180 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.609221:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992355968:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.609233:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356096:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.609239:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.609252:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.609659:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.609686:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.609742:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113856
00000100:00100000:3.0:1782361985.609749:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113856
00010000:00010000:3.0:1782361985.609769:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 114 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.609802:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985113984
00000100:00100000:3.0:1782361985.609816:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985113984
00010000:00010000:3.0:1782361985.609852:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 115 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.609857:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 72
00000100:00100000:2.0:1782361985.609867:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+114:2364:x1868940985113856:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.609874:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 73
00010000:00010000:2.0:1782361985.609879:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1782361985.609887:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+115:2365:x1868940985113984:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.609888:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 114 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609900:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.609906:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 114 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609909:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 115 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609930:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 115 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.609937:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f7b433b/0x57e58d5a90c7e0a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30b6 expref: 114 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609944:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e0df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30cb expref: 115 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609956:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.609959:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x229:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.609960:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.609963:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.609965:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.609975:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609976:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.609993:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.609998:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.610026:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+114:2365:x1868940985113984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 144us (339us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.610029:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.610039:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 73
00010000:00010000:3.0:1782361985.610050:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.610060:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+113:2364:x1868940985113856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 192us (398us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.610067:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.610074:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 72
00010000:00010000:3.0:1782361985.610084:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610093:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610113:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.610217:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.610222:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.610228:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.610231:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.610237:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.610249:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.610269:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7e8db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.610286:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.610288:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.610289:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.610583:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610598:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 112 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610606:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x227:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.610610:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.610613:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610648:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 112 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.610659:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 112 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.610673:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356224:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.610721:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835cc0 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.611190:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611209:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611218:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611226:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611251:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.611353:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.611360:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.611370:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.611375:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.611384:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.611399:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.611408:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e8e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x229:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.611425:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.611427:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.611436:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.611567:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611579:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 113 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611587:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x228:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.611590:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.611594:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611613:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 113 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.611622:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 113 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.611641:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356352:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.611685:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.611984:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356224:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.611998:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.612563:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.612713:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114112
00000100:00100000:3.0:1782361985.612719:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114112
00010000:00010000:3.0:1782361985.612744:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 113 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.612783:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 74
00000100:00100000:3.0:1782361985.612807:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+113:2365:x1868940985114112:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.612809:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356352:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.612822:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.612853:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.612861:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 113 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.612890:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 113 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.612957:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000048ef7b85/0x57e58d5a90c7e037 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb308c expref: 113 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.612970:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.612974:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.612979:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.612987:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.613009:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.613015:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.613042:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.613051:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+112:2365:x1868940985114112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 244us (485us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.613053:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114240
00010000:00010000:1.0:1782361985.613058:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.613059:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114240
00010000:00010000:1.0:1782361985.613075:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.613087:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 114 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613089:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.613122:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 74
00010000:00010000:1.0:1782361985.613130:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1782361985.613140:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 75
00010000:00010000:0.0:1782361985.613168:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.613176:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.613187:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cec00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.613191:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.613202:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.613208:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+114:2365:x1868940985114240:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.613219:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.613221:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.613233:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 114 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.613233:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e8e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.613269:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.613270:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 114 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.613272:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.613276:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.613287:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000540ac8b5/0x57e58d5a90c7e06f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb30a1 expref: 114 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.613298:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.613301:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x228:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.613305:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.613313:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.613335:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.613360:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.613369:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f75450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+113:2365:x1868940985114240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 219us (359us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.613375:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.613384:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 75
00010000:00010000:1.0:1782361985.613403:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613412:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613439:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.613451:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.613456:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613464:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7be00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.613468:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613475:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613486:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613491:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f8941baf/0x57e58d5a90c7e8f0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x228:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.613508:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.613516:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.613519:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.614224:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.614239:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 112 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.614246:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x227:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.614250:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.614254:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.614279:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 112 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.614288:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 112 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.614298:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356480:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.614338:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.614348:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.614355:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 111 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.614364:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x226:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.614374:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.614379:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 4/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.614401:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 111 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.614412:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 111 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.614423:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356608:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.614495:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.615284:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356608:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.615305:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.615305:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356480:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.615325:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.615736:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.615766:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.615795:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114496
00000100:00100000:3.0:1782361985.615799:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114368
00000100:00100000:2.0:1782361985.615803:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114496
00000100:00100000:3.0:1782361985.615814:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114368
00010000:00010000:3.0:1782361985.615860:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 112 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.615870:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 113 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.615891:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 76
00000100:00100000:3.0:1782361985.615901:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+112:2364:x1868940985114368:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.615913:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1782361985.615914:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 77
00010000:00010000:3.0:1782361985.615922:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 112 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.615937:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+113:2365:x1868940985114496:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.615952:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.615955:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 112 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.615960:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 113 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.615980:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 113 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.615981:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060e6c94c/0x57e58d5a90c7dfc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3062 expref: 112 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.616009:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.616010:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c59bf29e/0x57e58d5a90c7dfff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3077 expref: 113 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.616014:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.616021:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.616031:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616033:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.616038:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x227:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.616044:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.616048:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.616064:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616067:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616085:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616088:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.616092:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+111:2364:x1868940985114368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 186us (317us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.616097:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.616099:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 76
00010000:00010000:0.0:1782361985.616105:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.616131:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+112:2365:x1868940985114496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 192us (381us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.616140:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 77
00010000:00010000:0.0:1782361985.616190:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.616278:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.616284:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616292:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.616297:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616307:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616320:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616325:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e8fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.616337:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.616345:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.616347:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.616516:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616526:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 110 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616531:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x225:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.616533:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.616535:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616561:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 110 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.616569:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 110 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.616582:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356736:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.616624:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed34180 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.616921:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.616943:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.616953:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.616961:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.616976:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.617022:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.617029:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.617039:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7b400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.617043:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.617051:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.617062:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.617067:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c44ada1/0x57e58d5a90c7e8f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x227:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.617081:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.617083:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.617085:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.617302:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.617316:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 111 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.617324:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x226:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.617327:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.617331:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.617350:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 111 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.617361:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 111 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.617377:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356864:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.617418:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.618261:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356736:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.618270:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.618285:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.618316:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114624
00000100:00100000:1.0:1782361985.618322:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114624
00010000:00010000:1.0:1782361985.618345:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 111 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.618378:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 78
00000100:00100000:1.0:1782361985.618387:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+111:2365:x1868940985114624:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.618397:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.618402:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 111 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618414:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 111 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618428:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5948a98/0x57e58d5a90c7df57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3038 expref: 111 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618441:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.618444:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.618448:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618468:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618489:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.618512:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.618521:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+110:2365:x1868940985114624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 134us (254us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.618533:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 78
00010000:00010000:3.0:1782361985.618542:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.618552:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.618560:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.618741:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.618767:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.618774:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618783:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.618796:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618807:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618820:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618849:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7e905 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.618869:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.618877:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.618880:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.618891:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992356864:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.618910:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.619017:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.619054:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114752
00000100:00100000:1.0:1782361985.619058:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114752
00010000:00010000:1.0:1782361985.619073:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 112 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.619101:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 79
00000100:00100000:1.0:1782361985.619110:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+112:2365:x1868940985114752:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.619120:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.619125:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 112 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619137:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 112 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619152:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a006581a/0x57e58d5a90c7df8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb304d expref: 112 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619163:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.619167:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x226:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.619172:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619180:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619221:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.619255:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+111:2365:x1868940985114752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 146us (238us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.619263:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 79
00010000:00010000:3.0:1782361985.619312:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619319:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.619327:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 109 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619343:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.619345:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x224:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.619353:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.619364:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619364:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619381:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.619433:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 109 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619438:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.619447:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 109 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.619469:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356992:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.619520:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835600 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.619763:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619776:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 110 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619782:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x225:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.619786:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.619805:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619826:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 110 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.619861:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 110 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.619880:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357120:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.619920:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea0c0 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.619975:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.619981:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.619989:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7a800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.619992:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.620000:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.620012:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.620019:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001402779e/0x57e58d5a90c7e90c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x226:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.620032:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.620034:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.620036:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.620817:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992356992:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.620846:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.620961:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.620982:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985114880
00000100:00100000:1.0:1782361985.620996:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985114880
00010000:00010000:1.0:1782361985.621014:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 110 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.621020:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357120:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.621042:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.621089:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 80
00000100:00100000:1.0:1782361985.621096:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+110:2364:x1868940985114880:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.621103:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.621107:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 110 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621115:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 110 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621124:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fb370714/0x57e58d5a90c7dee7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb300e expref: 110 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621133:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.621135:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.621139:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621144:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621165:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.621167:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.621196:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.621196:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+109:2364:x1868940985114880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 97us (233us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.621211:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621222:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.621224:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 80
00010000:00010000:2.0:1782361985.621236:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621251:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.621260:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.621265:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621273:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cea00 already unused, calling callback (ffffffffc16b0e90)
00000100:00100000:1.0:1782361985.621284:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115008
00000100:00100000:1.0:1782361985.621289:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115008
00010000:00010000:2.0:1782361985.621292:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621304:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.621304:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 111 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621328:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621336:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7e913 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.621343:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 81
00000100:00100000:0.0:1782361985.621354:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+111:2364:x1868940985115008:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.621359:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.621362:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.621363:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.621367:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 111 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621369:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.621378:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 111 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621388:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000085a90ae3/0x57e58d5a90c7df1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3023 expref: 111 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621396:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.621398:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x225:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.621400:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621405:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621428:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.621447:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+110:2364:x1868940985115008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 95us (283us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.621450:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.621453:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 81
00010000:00010000:2.0:1782361985.621463:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621472:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621479:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621503:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.621540:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.621547:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621556:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.621560:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621569:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621592:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621600:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e91a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x225:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.621616:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.621618:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.621620:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.621986:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.621997:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 109 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.622002:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x224:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.622004:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.622007:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.622023:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 109 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.622030:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 109 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.622041:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357248:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.622098:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538feaf00 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.622109:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.622124:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 108 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.622132:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x223:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.622135:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.622139:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.622158:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 108 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.622167:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 108 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.622190:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357376:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.622219:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835600 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.624664:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.624686:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357248:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.624705:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357376:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.624713:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.624718:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.624725:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.624752:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115264
00000100:00100000:0.0:1782361985.624759:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115264
00000100:00100000:1.0:1782361985.624766:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115136
00000100:00100000:1.0:1782361985.624773:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115136
00010000:00010000:0.0:1782361985.624798:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 109 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.624806:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 110 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.624856:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 82
00000100:00100000:0.0:1782361985.624868:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+109:2365:x1868940985115264:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1782361985.624875:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 83
00010000:00010000:0.0:1782361985.624880:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1782361985.624888:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+110:2364:x1868940985115136:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.624889:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 109 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624899:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.624906:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 109 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624907:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 110 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624930:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 110 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.624942:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005d824f30/0x57e58d5a90c7de77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fe4 expref: 109 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624945:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee5e6c08/0x57e58d5a90c7deaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ff9 expref: 110 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624969:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.624971:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.624974:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x224:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.624977:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.624978:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.624986:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.624989:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625010:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625025:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.625039:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.625047:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625058:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.625070:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+109:2364:x1868940985115136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 182us (352us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.625071:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625071:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.625079:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f74c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+108:2365:x1868940985115264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 209us (419us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.625093:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 83
00010000:00010000:1.0:1782361985.625098:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.625100:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.625116:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 82
00010000:00010000:3.0:1782361985.625134:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625134:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.625144:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625152:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.625159:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.625169:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.625182:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.625187:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625197:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625211:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625219:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7e921 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x224:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625237:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.625239:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.625243:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.625244:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.625247:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.625264:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfe00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.625272:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625281:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625292:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625300:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7e928 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.625314:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.625316:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.625318:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.625733:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625747:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 108 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625754:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x223:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.625758:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625758:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.625766:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.625773:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 107 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.625800:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x222:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.625804:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.625809:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625810:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 108 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.625858:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 108 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.625869:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 107 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.625874:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357504:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.625888:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 107 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.625901:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357632:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.625935:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.625944:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835c00 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.627535:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357504:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.627556:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.627558:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357632:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.627670:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.627689:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.627722:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115392
00000100:00100000:0.0:1782361985.627728:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115392
00010000:00010000:0.0:1782361985.627749:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 108 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.627783:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 84
00000100:00100000:0.0:1782361985.627803:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+108:2364:x1868940985115392:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.627813:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.627818:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 108 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627825:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 108 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627856:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020f6748d/0x57e58d5a90c7de07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fba expref: 108 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627866:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.627868:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.627872:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627877:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627894:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.627897:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.627923:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.627925:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+107:2364:x1868940985115392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 135us (237us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.627938:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 84
00010000:00010000:3.0:1782361985.627942:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.627956:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.627962:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115520
00000100:00100000:0.0:1782361985.627967:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115520
00010000:00010000:3.0:1782361985.627977:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.627981:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 109 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.628002:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 85
00010000:00010000:3.0:1782361985.628009:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.628009:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+109:2365:x1868940985115520:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.628018:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.628022:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 109 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628030:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 109 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628041:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000026095760/0x57e58d5a90c7de3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fcf expref: 109 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628049:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.628052:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.628053:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x223:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.628061:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628062:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628077:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628082:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.628090:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628100:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.628103:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.628116:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.628127:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+108:2365:x1868940985115520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.628140:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 85
00010000:00010000:3.0:1782361985.628214:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.628223:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.628229:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.628233:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628239:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7e936 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628271:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.628271:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.628277:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628285:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.628288:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628295:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.628306:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:2.0:1782361985.628307:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628322:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e92f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x223:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.628339:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.628342:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.628344:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.629203:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.629218:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 107 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.629219:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.629240:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x222:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.629245:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 106 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.629247:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.629256:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x221:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.629259:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.629261:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.629274:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.629288:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 107 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.629298:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 106 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.629306:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 107 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.629309:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 106 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.629333:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357888:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.629337:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357760:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.629401:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.629402:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.630292:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992357888:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.630304:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992357760:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.630311:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.630316:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.631050:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.631084:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.631107:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115648
00000100:00100000:3.0:1782361985.631119:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115776
00000100:00100000:3.0:1782361985.631125:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115776
00010000:00010000:3.0:1782361985.631148:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 107 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.631167:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115648
00000100:00100000:3.0:1782361985.631184:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 86
00010000:00010000:0.0:1782361985.631190:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 108 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.631201:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+107:2365:x1868940985115776:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.631215:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.631222:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 107 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.631226:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 87
00000100:00100000:0.0:1782361985.631238:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+108:2364:x1868940985115648:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.631251:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.631258:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 107 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631259:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 108 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631284:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 108 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631291:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000082b83a4a/0x57e58d5a90c7dd97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f90 expref: 107 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631303:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007389910b/0x57e58d5a90c7ddcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2fa5 expref: 108 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631307:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.631316:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.631320:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631320:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.631328:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x222:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.631333:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631335:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631348:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631364:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.631385:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.631400:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+106:2365:x1868940985115776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 204us (314us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.631409:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 86
00000100:00100000:0.0:1782361985.631414:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+107:2364:x1868940985115648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 176us (363us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.631423:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 87
00010000:00010000:1.0:1782361985.631434:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631446:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631449:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631460:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631463:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631480:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631490:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.631495:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631516:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1782361985.631526:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.631538:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1782361985.631545:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631554:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7a200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.631558:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631568:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631582:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631590:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e944 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631606:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.631609:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.631613:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.631614:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.631616:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.631637:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cec00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.631642:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631650:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631663:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631669:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7e93d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x222:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631681:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631685:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.631688:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.631698:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 105 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.631699:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.631709:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x220:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.631714:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.631717:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631744:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 105 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.631759:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 105 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.631772:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358016:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.631861:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a780 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.631984:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.632035:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 106 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.632042:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x221:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.632046:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.632049:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.632069:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 106 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.632079:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 106 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.632089:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358144:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.632129:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835180 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.633074:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358016:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.633099:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.633390:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.633470:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985115904
00000100:00100000:3.0:1782361985.633475:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985115904
00010000:00010000:3.0:1782361985.633497:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 106 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.633519:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 88
00000100:00100000:3.0:1782361985.633524:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+106:2362:x1868940985115904:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.633533:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.633575:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 106 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.633583:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 106 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.633595:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e9b2fadd/0x57e58d5a90c7dd27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f66 expref: 106 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.633604:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.633607:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.633611:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.633616:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.633632:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.633653:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358144:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.633655:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633671:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.633673:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+105:2362:x1868940985115904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 146us (280us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.633681:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633704:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.633710:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 88
00010000:00010000:1.0:1782361985.633720:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633738:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.633760:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.633767:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.633776:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7ac00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.633780:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.633800:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.633814:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.633822:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006bb53d66/0x57e58d5a90c7e94b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.633879:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.633883:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.633885:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.633897:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633910:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 104 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633918:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21f:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.633921:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.633925:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633954:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 104 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.633965:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 104 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.633977:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358272:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.634014:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.634099:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.634132:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116032
00000100:00100000:2.0:1782361985.634137:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116032
00010000:00010000:2.0:1782361985.634155:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 107 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.634173:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 89
00000100:00100000:2.0:1782361985.634179:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+107:2365:x1868940985116032:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.634185:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.634189:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 107 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634204:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 107 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634218:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009602e1c3/0x57e58d5a90c7dd5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f7b expref: 107 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634228:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.634231:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x221:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.634235:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634242:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634275:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.634310:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f75850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+106:2365:x1868940985116032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (211us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.634318:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 89
00010000:00010000:0.0:1782361985.634327:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634349:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634357:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634365:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634382:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.634388:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.634393:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634401:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.634405:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634420:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634433:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634441:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bf99f17/0x57e58d5a90c7e952 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x221:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.634465:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.634469:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.634471:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.634503:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634517:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 105 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634524:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x220:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.634527:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.634531:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634552:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 105 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.634561:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 105 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.634579:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358400:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.634614:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.634730:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358272:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.634742:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.635210:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.635251:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116160
00000100:00100000:0.0:1782361985.635256:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116160
00010000:00010000:0.0:1782361985.635278:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 105 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.635314:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358400:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.635315:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 90
00000100:00100000:0.0:1782361985.635327:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+105:2365:x1868940985116160:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.635333:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635335:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.635345:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 105 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635357:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 105 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635370:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ae39ff61/0x57e58d5a90c7dcb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f3c expref: 105 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635379:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.635382:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.635385:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635402:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635430:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.635455:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.635461:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+104:2365:x1868940985116160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 134us (249us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.635473:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.635478:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 90
00010000:00010000:1.0:1782361985.635489:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.635506:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.635523:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.635543:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.635550:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635560:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7a800 already unused, calling callback (ffffffffc16b0e90)
00000100:00100000:2.0:1782361985.635561:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.635566:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635575:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635592:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635599:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001402779e/0x57e58d5a90c7e959 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635618:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.635624:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116288
00010000:00010000:1.0:1782361985.635625:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.635630:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116288
00010000:00010000:1.0:1782361985.635643:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 103 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635643:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.635648:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 106 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635648:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.635661:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21e:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.635666:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.635670:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.635679:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 91
00000100:00100000:3.0:1782361985.635686:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+106:2364:x1868940985116288:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.635694:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.635696:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 103 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.635700:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 106 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.635722:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 106 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.635723:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 103 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.635744:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005ee2d318/0x57e58d5a90c7dcef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f51 expref: 106 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.635748:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358528:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.635758:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.635762:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x220:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.635765:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.635770:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.635807:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.635810:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.635850:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+105:2364:x1868940985116288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 142us (272us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.635853:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.635858:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 91
00010000:00010000:0.0:1782361985.635868:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635878:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635886:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.635902:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.635910:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.635916:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.635947:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.635952:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.635961:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.635974:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.635981:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7e960 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x220:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.635995:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.636004:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.636006:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.636020:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.636033:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 104 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.636040:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21f:0x0].0x0 since=196s v=(0 0)
00010000:00010000:0.0:1782361985.636043:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.636047:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.636068:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 104 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.636090:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 104 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.636100:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358656:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.636139:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed343c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.636734:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358528:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.636758:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.636981:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358656:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.636991:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.637181:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.637207:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.637210:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116416
00000100:00100000:2.0:1782361985.637216:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116416
00010000:00010000:2.0:1782361985.637233:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 104 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.637248:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116544
00000100:00100000:0.0:1782361985.637254:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116544
00000100:00100000:2.0:1782361985.637261:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92
00000100:00100000:2.0:1782361985.637271:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+104:2365:x1868940985116416:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.637275:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 105 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637282:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.637290:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 104 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637311:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 104 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.637312:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93
00000100:00100000:0.0:1782361985.637328:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+105:2365:x1868940985116544:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.637330:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002ea031dc/0x57e58d5a90c7dc47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f12 expref: 104 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637340:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.637341:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.637346:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.637350:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 105 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637351:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637367:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637383:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 105 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637389:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.637401:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008ccc046f/0x57e58d5a90c7dc7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2f27 expref: 105 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637407:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.637424:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+103:2365:x1868940985116416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 151us (239us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.637428:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637434:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.637435:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637443:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21f:0x0].0x0 since=0s v=(1 0)
00000100:00100000:2.0:1782361985.637454:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92
00010000:00010000:1.0:1782361985.637456:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637456:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.637477:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637481:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.637503:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.637506:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.637511:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637521:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7b400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.637526:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637536:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.637538:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+104:2365:x1868940985116544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 214us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.637555:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93
00010000:00010000:3.0:1782361985.637561:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637570:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c44ada1/0x57e58d5a90c7e967 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637577:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637588:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 102 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637590:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.637593:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637594:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.637595:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21d:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.637602:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.637605:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.637609:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637613:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637632:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637644:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 102 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637658:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.637660:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 102 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637680:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1782361985.637681:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358784:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.637701:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.637707:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637716:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.637720:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637729:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.637737:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.637742:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637780:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637803:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7e96e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637809:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 103 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637821:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21e:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.637825:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.637864:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.637884:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 103 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637894:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.637895:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 103 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.637899:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.637902:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.637911:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358912:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.637951:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea900 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.638518:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992358784:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.638531:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.638728:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.638732:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3cb480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992358912:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.638754:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.638769:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116672
00000100:00100000:3.0:1782361985.638773:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116672
00010000:00010000:3.0:1782361985.638798:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 103 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.638818:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94
00000100:00100000:3.0:1782361985.638822:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+103:2364:x1868940985116672:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.638856:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.638863:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 103 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.638874:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 103 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.638885:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004938dbe6/0x57e58d5a90c7dbd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ee8 expref: 103 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.638893:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.638895:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.638898:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.638903:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.638918:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.638947:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.638949:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+102:2364:x1868940985116672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 125us (223us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.638955:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94
00010000:00010000:1.0:1782361985.638956:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.638964:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.638972:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.638999:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.639022:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.639029:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639039:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7be00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.639044:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639054:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639068:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639082:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f8941baf/0x57e58d5a90c7e975 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639087:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639097:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.639100:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.639103:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 101 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639104:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.639113:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21c:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.639116:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.639120:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639137:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 101 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639147:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 101 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.639155:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359040:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.639188:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a9c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.639266:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.639314:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116800
00000100:00100000:1.0:1782361985.639319:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116800
00010000:00010000:1.0:1782361985.639337:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 104 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.639372:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95
00000100:00100000:1.0:1782361985.639380:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+104:2364:x1868940985116800:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.639388:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.639393:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 104 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639412:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 104 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639429:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005cedb143/0x57e58d5a90c7dc0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2efd expref: 104 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639438:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.639441:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.639445:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639452:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.639468:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.639477:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639486:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.639495:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+103:2364:x1868940985116800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (229us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.639497:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.639509:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95
00010000:00010000:2.0:1782361985.639512:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639545:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.639608:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.639615:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639624:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.639628:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639637:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639647:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639651:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639667:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 102 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639668:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7e97c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639687:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21d:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.639692:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.639696:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.639698:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.639701:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.639710:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.639731:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 102 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.639741:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 102 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.639751:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359168:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.639782:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea0c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.640085:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359040:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.640098:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.640196:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.640238:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985116928
00000100:00100000:0.0:1782361985.640248:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985116928
00010000:00010000:0.0:1782361985.640269:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 102 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.640293:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96
00000100:00100000:0.0:1782361985.640301:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+102:2365:x1868940985116928:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.640310:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.640315:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 102 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.640326:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 102 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.640339:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002ef5b85/0x57e58d5a90c7db67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ebe expref: 102 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.640349:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.640353:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.640357:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.640365:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.640389:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.640418:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.640427:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f74850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+101:2365:x1868940985116928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 124us (228us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.640435:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.640440:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96
00010000:00010000:1.0:1782361985.640450:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640456:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640472:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.640496:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.640503:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.640512:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c7a200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.640517:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.640526:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.640539:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.640546:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5ef3cdf/0x57e58d5a90c7e983 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640555:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640581:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 100 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.640586:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.640589:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.640592:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.640592:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21b:0x0].0x0 since=196s v=(0 0)
00010000:00010000:1.0:1782361985.640598:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.640603:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640626:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 100 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.640633:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 100 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.640641:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359296:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.640676:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.640767:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359168:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.640780:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.641077:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.641096:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117056
00000100:00100000:1.0:1782361985.641100:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117056
00010000:00010000:1.0:1782361985.641116:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 103 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.641139:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97
00000100:00100000:1.0:1782361985.641145:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+103:2365:x1868940985117056:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.641153:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.641158:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 103 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641169:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 103 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641182:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b21a6614/0x57e58d5a90c7db9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ed3 expref: 103 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641213:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.641217:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.641222:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641230:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641252:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.641284:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+102:2365:x1868940985117056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (207us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.641292:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97
00010000:00010000:2.0:1782361985.641299:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641309:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641316:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641324:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641344:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.641367:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.641373:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.641382:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.641387:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.641401:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.641417:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.641425:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7e98a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.641447:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.641449:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.641451:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.641457:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641470:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 101 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641489:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21c:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.641493:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21c:0x0].0x0 since=0s v=(1 0)
00000100:00100000:1.0:1782361985.641498:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359296:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.641499:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641515:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641526:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 101 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.641536:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 101 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.641547:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359424:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.641587:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea900 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.641809:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.641870:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117184
00000100:00100000:1.0:1782361985.641876:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117184
00010000:00010000:1.0:1782361985.641894:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 101 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.641923:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98
00000100:00100000:1.0:1782361985.641933:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+101:2365:x1868940985117184:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.641942:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.641953:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 101 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641966:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 101 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641980:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f98c8e5/0x57e58d5a90c7daf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e94 expref: 101 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.641990:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.641994:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.641999:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.642008:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.642030:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.642034:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642047:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642053:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642057:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.642063:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+100:2365:x1868940985117184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (252us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.642072:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98
00010000:00010000:3.0:1782361985.642073:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.642099:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.642106:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.642115:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.642119:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.642128:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.642141:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.642156:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7e991 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642167:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.642170:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.642173:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.642175:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.642214:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 99 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642219:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x21a:0x0].0x0 since=196s v=(0 0)
00010000:00010000:3.0:1782361985.642221:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.642224:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642239:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 99 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.642248:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 99 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.642315:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359552:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.642346:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835d80 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.644069:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359424:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.644077:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.644092:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.644115:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117312
00000100:00100000:0.0:1782361985.644120:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117312
00010000:00010000:0.0:1782361985.644139:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 102 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.644189:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99
00000100:00100000:0.0:1782361985.644200:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+102:2364:x1868940985117312:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.644210:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.644216:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 102 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644228:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 102 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644241:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000627fbf3a/0x57e58d5a90c7db2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ea9 expref: 102 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644250:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.644252:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.644256:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644265:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644292:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.644328:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+101:2364:x1868940985117312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 131us (255us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.644336:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99
00010000:00010000:2.0:1782361985.644394:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644400:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644406:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644410:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644423:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.644540:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644559:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 100 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644564:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21b:0x0].0x0 since=196s v=(0 0)
00010000:00010000:2.0:1782361985.644567:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.644571:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.644579:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359552:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.644595:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644596:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 100 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.644621:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 100 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.644644:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359680:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.644685:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e538fea0c0 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.644716:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.644722:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644730:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.644733:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644742:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644753:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644760:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7e998 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.644776:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.644778:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.644779:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.645519:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.645563:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117440
00000100:00100000:1.0:1782361985.645574:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117440
00000100:00100000:2.0:1782361985.645594:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359680:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.645597:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 100 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.645611:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.645643:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 100
00000100:00100000:1.0:1782361985.645652:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+100:2364:x1868940985117440:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.645661:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.645666:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 100 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645673:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 100 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645683:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046a74bb6/0x57e58d5a90c7da87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e6a expref: 100 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645691:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.645694:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.645697:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645706:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645737:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.645767:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.645776:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+99:2364:x1868940985117440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 124us (257us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.645804:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 100
00000100:00100000:1.0:1782361985.645820:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117568
00000100:00100000:1.0:1782361985.645824:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117568
00010000:00010000:1.0:1782361985.645866:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 101 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.645893:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 101
00000100:00100000:1.0:1782361985.645903:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+101:2364:x1868940985117568:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.645911:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.645916:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 101 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.645923:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645928:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 101 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.645939:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.645949:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645952:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000e40bd3d/0x57e58d5a90c7dabf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e7f expref: 101 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645964:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.645966:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.645969:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.645980:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.645984:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.645992:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.645996:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.646003:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646031:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.646034:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646041:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.646042:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.646058:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646059:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646068:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7e99f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646069:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.646083:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+100:2364:x1868940985117568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 182us (313us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.646095:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.646099:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.646100:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 101
00010000:00010000:0.0:1782361985.646101:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646102:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.646113:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.646114:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.646137:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 98 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646141:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.646144:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x219:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.646148:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.646149:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.646155:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.646158:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 4/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646174:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.646178:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646186:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.646207:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 98 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646208:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646219:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9a6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.646231:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.646232:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.646234:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.646243:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646259:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.646266:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 98 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646269:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x21a:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.646278:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21a:0x0].0x0 since=0s v=(1 0)
00000100:00100000:3.0:1782361985.646283:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359808:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.646284:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646311:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 99 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.646322:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 99 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.646327:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835c00 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.646338:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359936:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.646383:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.647258:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992359808:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.647271:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.647420:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.647497:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992359936:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.647507:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.647512:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117696
00000100:00100000:0.0:1782361985.647517:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117696
00010000:00010000:0.0:1782361985.647537:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 99 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.647599:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 102
00000100:00100000:0.0:1782361985.647606:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+99:2364:x1868940985117696:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.647615:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.647621:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 99 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.647632:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 99 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.647646:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092bff933/0x57e58d5a90c7da17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e40 expref: 99 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.647657:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.647660:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.647664:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.647673:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.647706:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.647725:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.647733:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.647738:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+98:2364:x1868940985117696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (315us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.647752:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 102
00010000:00010000:3.0:1782361985.647754:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.647759:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.647769:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.647802:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.647809:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.647818:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.647822:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.647842:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.647857:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.647867:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.647872:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7e9ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.647897:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.647899:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.647901:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.647912:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117824
00000100:00100000:2.0:1782361985.647917:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117824
00010000:00010000:2.0:1782361985.647935:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 100 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.647967:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 103
00000100:00100000:2.0:1782361985.647976:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+100:2365:x1868940985117824:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.647985:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.647991:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 100 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648001:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 100 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648016:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f470ab35/0x57e58d5a90c7da4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e55 expref: 100 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648029:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.648032:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.648036:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.648041:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.648054:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 97 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648060:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.648061:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x218:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.648068:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.648075:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.648092:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 97 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648093:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.648102:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 97 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.648111:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360064:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.648123:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f75c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+99:2365:x1868940985117824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 147us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.648130:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 103
00000100:00100000:3.0:1782361985.648146:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835c00 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.648226:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648245:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648254:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648261:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648281:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.648319:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.648326:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.648336:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.648340:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.648350:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.648365:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648367:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.648384:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7e9b4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648388:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 98 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648412:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x219:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.648414:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.648416:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.648417:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.648419:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.648423:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.648438:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 98 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.648448:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 98 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.648458:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360192:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.648492:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52e37cc00 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.649114:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360064:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.649130:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.650234:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360192:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.650255:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.650326:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.650357:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985117952
00000100:00100000:0.0:1782361985.650358:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.650365:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985117952
00010000:00010000:2.0:1782361985.650398:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 98 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.650432:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118080
00000100:00100000:2.0:1782361985.650437:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118080
00010000:00010000:2.0:1782361985.650453:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 99 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.650463:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 104
00000100:00100000:0.0:1782361985.650475:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+98:2364:x1868940985117952:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.650485:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.650491:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 98 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.650506:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 98 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.650529:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ad4592/0x57e58d5a90c7d9a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e16 expref: 98 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.650544:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.650547:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.650552:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.650562:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.650621:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 105
00000100:00100000:2.0:1782361985.650632:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+99:2364:x1868940985118080:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.650642:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.650649:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 99 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.650663:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 99 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.650680:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d0b2e9d5/0x57e58d5a90c7d9df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e2b expref: 99 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.650690:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.650694:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x219:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.650698:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.650706:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.650745:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.650799:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+98:2364:x1868940985118080:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 155us (426us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.650807:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 105
00010000:00010000:0.0:1782361985.652356:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.652395:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+97:2364:x1868940985117952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1920us (2067us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.652403:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 104
00010000:00010000:0.0:1782361985.652438:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.652449:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.652458:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.652466:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.652482:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.652603:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.652611:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.652617:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.652620:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.652627:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.652639:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.652644:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9bb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.652667:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.652670:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.652673:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.655393:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.655415:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.655425:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.655433:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.655451:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.655533:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.655541:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.655552:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.655556:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.655566:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.655582:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.655589:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7e9c2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x219:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.655606:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.655609:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.655611:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.655802:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.655822:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 96 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.655864:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x217:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.655868:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.655881:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.655922:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 96 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.655938:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 96 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.655954:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360320:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.656095:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed340c0 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.656885:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.656901:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 97 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.656909:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x218:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.656913:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.656918:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.656943:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 97 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.656949:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360320:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.656958:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 97 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.656975:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.656980:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360448:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.657040:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52e37c300 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.658018:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.658108:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.658134:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118208
00000100:00100000:0.0:1782361985.658141:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118208
00010000:00010000:0.0:1782361985.658171:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 97 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.658206:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118336
00000100:00100000:0.0:1782361985.658210:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118336
00000100:00100000:1.0:1782361985.658225:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 106
00010000:00010000:0.0:1782361985.658227:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 98 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.658243:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+97:2365:x1868940985118208:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.658258:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1782361985.658265:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360448:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.658266:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 97 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.658282:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 107
00010000:00010000:1.0:1782361985.658285:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 97 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.658296:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+98:2364:x1868940985118336:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.658302:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000df4518ec/0x57e58d5a90c7d937 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dec expref: 97 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.658314:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.658319:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.658324:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.658330:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.658349:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.658438:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.658447:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 98 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.658462:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 98 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.658480:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e69d9a18/0x57e58d5a90c7d96f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2e01 expref: 98 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.658487:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.658498:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.658503:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x218:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.658508:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.658512:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.658521:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.658525:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.658527:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+96:2365:x1868940985118208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 288us (514us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.658547:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 106
00010000:00010000:3.0:1782361985.658558:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.658561:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.658563:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.658579:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.658589:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+97:2364:x1868940985118336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 297us (482us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.658591:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.658600:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.658601:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 107
00010000:00010000:2.0:1782361985.658611:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.658616:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658626:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658639:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658646:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7e9c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658662:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.658670:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.658673:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.658682:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658692:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658701:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.658710:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.659178:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.659263:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.659269:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659276:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659291:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 95 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659314:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x216:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.659315:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.659319:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.659322:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659325:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659356:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 95 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.659360:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.659380:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 95 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.659385:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.659399:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7e9d0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x218:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.659401:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360576:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.659454:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.659468:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 96 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.659475:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x217:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.659479:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.659483:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 4/0,1 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.659504:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 96 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.659525:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 96 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.659537:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360704:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.659547:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.659558:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.659562:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.659564:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.659586:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4900 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.660590:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360576:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.660606:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.660960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.660998:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118464
00000100:00100000:2.0:1782361985.661005:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118464
00010000:00010000:2.0:1782361985.661035:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 96 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.661071:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108
00000100:00100000:2.0:1782361985.661081:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+96:2363:x1868940985118464:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.661093:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.661099:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 96 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661126:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 96 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661145:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e06375db/0x57e58d5a90c7d8c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dc2 expref: 96 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661157:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.661161:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.661173:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661183:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661216:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.661221:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360704:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.661228:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661240:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661249:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661257:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661272:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.661273:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+95:2363:x1868940985118464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 176us (296us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.661284:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108
00010000:00010000:2.0:1782361985.661316:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.661322:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661330:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.661334:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661344:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661356:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661363:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000096646366/0x57e58d5a90c7e9d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661374:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.661404:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 94 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.661407:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.661412:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.661415:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x215:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.661416:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.661421:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.661426:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.661901:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.661958:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.662222:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118592
00000100:00100000:0.0:1782361985.662228:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118592
00010000:00010000:0.0:1782361985.662251:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 97 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.662281:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 109
00000100:00100000:0.0:1782361985.662290:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+97:2365:x1868940985118592:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.662300:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.662306:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 97 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662320:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 97 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662336:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004db7e8f8/0x57e58d5a90c7d8ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dd7 expref: 97 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662348:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.662352:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x217:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.662356:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662364:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662399:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.662413:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.662424:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.662433:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+96:2365:x1868940985118592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 142us (476us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.662438:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.662445:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 109
00010000:00010000:3.0:1782361985.662454:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.662486:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.662524:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 94 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.662538:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 94 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.662551:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360832:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.662562:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.662570:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.662579:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.662584:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.662594:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.662615:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 1/0,0 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.662620:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7e9de lrc: 0/0,0 mode: --/PW res: [0x240000400:0x217:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.662634:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.662637:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.662639:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.662667:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52ed34180 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.663173:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.663187:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 95 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.663204:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x216:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.663207:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.663210:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 4/0,1 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.663231:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 95 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.663239:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 95 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.663248:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360960:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.663290:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.664064:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992360832:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.664066:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.664089:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.664100:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118720
00000100:00100000:1.0:1782361985.664106:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118720
00010000:00010000:1.0:1782361985.664129:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 95 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.664160:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 110
00000100:00100000:1.0:1782361985.664172:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+95:2365:x1868940985118720:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.664182:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.664188:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 95 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.664197:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 95 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.664209:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dedfdf4a/0x57e58d5a90c7d857 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d98 expref: 95 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.664230:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.664234:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.664238:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.664247:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.664279:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.664312:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f77850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+94:2365:x1868940985118720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 143us (247us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.664317:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 110
00010000:00010000:3.0:1782361985.664362:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664374:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664384:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664398:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664417:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.664426:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.664432:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.664442:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.664447:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.664457:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.664463:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fdc00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992360960:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.664473:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.664483:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7e9e5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.664485:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664624:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664638:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 93 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664646:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x214:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.664649:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.664654:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664678:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 93 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.664691:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 93 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.664807:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361088:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.664903:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835c00 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.664909:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.664913:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.664917:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.664990:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.665112:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118848
00000100:00100000:2.0:1782361985.665117:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118848
00010000:00010000:2.0:1782361985.665137:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 96 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.665165:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 111
00000100:00100000:2.0:1782361985.665174:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+96:2365:x1868940985118848:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.665189:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.665195:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 96 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665206:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 96 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665220:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016e5bdd1/0x57e58d5a90c7d88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2dad expref: 96 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665231:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.665234:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x216:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.665237:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665244:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665264:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.665296:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+95:2365:x1868940985118848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 122us (302us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.665296:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.665311:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 111
00010000:00010000:0.0:1782361985.665314:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665339:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665347:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665367:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.665378:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.665383:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665389:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.665392:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665401:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665412:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 1/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665420:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7e9ec lrc: 0/0,0 mode: --/PW res: [0x240000400:0x216:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.665436:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.665438:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.665439:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.665737:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665751:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 94 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665760:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x215:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.665764:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.665769:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 4/0,1 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665806:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 94 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.665818:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 94 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.665925:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361216:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.665980:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5012edcc0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.668480:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.668516:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985118976
00000100:00100000:2.0:1782361985.668523:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985118976
00010000:00010000:2.0:1782361985.668549:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 94 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.668581:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 112
00000100:00100000:2.0:1782361985.668591:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+94:2365:x1868940985118976:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.668611:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1782361985.668615:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361088:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.668621:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 94 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668641:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 94 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.668653:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668662:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009885bcc5/0x57e58d5a90c7d7e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d6e expref: 94 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668678:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.668681:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.668686:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668695:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668718:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.668738:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.668748:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.668754:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+93:2365:x1868940985118976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 163us (277us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.668762:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.668767:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 112
00010000:00010000:3.0:1782361985.668777:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.668805:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.668815:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.668822:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668863:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.668867:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668877:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668890:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668897:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7e9f3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.668928:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.668930:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.668933:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.669000:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669011:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 92 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669016:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x213:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.669019:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.669021:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.669047:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361216:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.669064:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669096:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 92 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669110:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 92 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.669120:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361344:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.669168:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835d80 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.669588:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.669625:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119104
00000100:00100000:0.0:1782361985.669631:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119104
00010000:00010000:0.0:1782361985.669651:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 95 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.669677:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 113
00000100:00100000:0.0:1782361985.669685:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+95:2365:x1868940985119104:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.669694:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.669699:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 95 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.669710:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 95 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.669724:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000af13cfba/0x57e58d5a90c7d81f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d83 expref: 95 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.669734:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.669737:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x215:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.669741:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.669750:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.669780:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.669808:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.669816:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+94:2365:x1868940985119104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (227us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.669820:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.669826:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 113
00010000:00010000:2.0:1782361985.669851:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.669859:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.669877:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.669893:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.669899:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669908:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.669912:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669921:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669970:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 1/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.669978:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079e073c1/0x57e58d5a90c7e9fa lrc: 0/0,0 mode: --/PW res: [0x240000400:0x215:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.670010:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.670015:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.670019:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.670103:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.670113:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 93 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.670118:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x214:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.670120:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.670123:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.670140:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 93 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.670150:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 93 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.670161:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361472:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.670207:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.670538:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361344:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.670551:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.670806:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.670925:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119232
00000100:00100000:2.0:1782361985.670930:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119232
00010000:00010000:2.0:1782361985.670945:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 93 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.670967:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 114
00000100:00100000:2.0:1782361985.670974:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+93:2364:x1868940985119232:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.670982:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.670988:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 93 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.670997:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361472:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.671003:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 93 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671014:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671020:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ce38de6b/0x57e58d5a90c7d777 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d44 expref: 93 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671036:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.671039:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.671043:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671051:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671080:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.671110:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+92:2364:x1868940985119232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 136us (304us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.671117:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 114
00010000:00010000:3.0:1782361985.671132:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671142:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671151:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671159:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671179:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.671194:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.671268:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119360
00000100:00100000:1.0:1782361985.671274:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119360
00010000:00010000:1.0:1782361985.671296:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 94 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671312:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.671322:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 115
00010000:00010000:3.0:1782361985.671328:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 91 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.671330:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+94:2364:x1868940985119360:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.671341:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.671345:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 94 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.671367:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 94 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671368:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x212:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.671372:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.671380:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.671389:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003929afb9/0x57e58d5a90c7d7af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d59 expref: 94 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.671400:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.671405:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 91 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.671405:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x214:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.671411:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.671425:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.671430:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 91 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.671442:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361600:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.671444:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.671454:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671464:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671470:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671475:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.671484:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+93:2364:x1868940985119360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 153us (289us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.671485:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835180 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.671486:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:1.0:1782361985.671497:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 115
00010000:00010000:0.0:1782361985.671711:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671727:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 92 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671731:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x213:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.671733:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.671736:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671748:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 92 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.671754:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 92 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.671760:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361728:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.671797:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ecc0 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.671851:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1782361985.671864:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671876:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.671880:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671889:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671902:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671909:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ea01 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671923:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.671927:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671944:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.671947:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671955:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671965:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671973:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea08 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x214:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.671986:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.671988:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.671990:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.671997:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.672428:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361600:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.672440:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.672965:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.673003:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119488
00000100:00100000:0.0:1782361985.673008:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119488
00010000:00010000:0.0:1782361985.673034:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 92 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.673059:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 116
00000100:00100000:0.0:1782361985.673066:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+92:2364:x1868940985119488:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.673078:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.673090:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 92 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673102:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 92 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673118:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000591e988e/0x57e58d5a90c7d707 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d1a expref: 92 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673129:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.673132:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.673137:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673146:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673166:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.673177:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673189:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673198:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.673206:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+91:2364:x1868940985119488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (229us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.673222:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.673222:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 116
00010000:00010000:3.0:1782361985.673242:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.673270:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.673277:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673285:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.673289:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673310:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673326:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673334:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ea0f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673348:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.673350:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.673351:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.673370:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361728:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.673392:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.673472:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.673493:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673508:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 90 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.673509:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119616
00000100:00100000:2.0:1782361985.673516:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119616
00010000:00010000:2.0:1782361985.673535:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 93 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673555:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x211:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.673560:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x211:0x0].0x0 since=0s v=(1 0)
00000100:00100000:2.0:1782361985.673565:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 117
00010000:00010000:3.0:1782361985.673566:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.673577:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+93:2364:x1868940985119616:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.673589:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.673592:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 90 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673604:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 93 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673610:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 90 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673625:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 93 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.673630:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361856:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.673649:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c6a3834d/0x57e58d5a90c7d73f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d2f expref: 93 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673660:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.673663:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x213:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.673666:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.673671:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.673682:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835240 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.673690:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.673712:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f75050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+92:2364:x1868940985119616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (242us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.673713:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.673721:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 117
00010000:00010000:0.0:1782361985.673731:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673753:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673762:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.673779:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.673899:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.673905:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673925:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.673929:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673975:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673988:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.673995:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea16 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x213:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.674010:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.674012:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.674015:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.674070:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.674084:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 91 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.674091:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x212:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.674094:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.674097:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.674116:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 91 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.674126:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 91 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.674137:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361984:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.674183:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ecc0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.679487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.679542:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119744
00000100:00100000:1.0:1782361985.679549:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.679554:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119744
00000100:00100000:0.0:1782361985.679588:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992361984:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.679589:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985119872
00010000:00010000:2.0:1782361985.679594:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 91 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.679595:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985119872
00010000:00010000:0.0:1782361985.679618:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.679621:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 92 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.679636:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 118
00000100:00100000:2.0:1782361985.679655:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+91:2364:x1868940985119744:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.679668:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.679675:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 91 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.679678:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992361856:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.679698:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 91 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.679709:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.679720:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bcf3af6e/0x57e58d5a90c7d697 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cf0 expref: 91 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.679736:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x211:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.679740:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x211:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.679746:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.679756:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.679814:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 119
00000100:00100000:1.0:1782361985.679825:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+92:2365:x1868940985119872:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.679862:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.679868:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 92 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.679881:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 92 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.679898:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c5f6f632/0x57e58d5a90c7d6cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2d05 expref: 92 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.679900:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.679914:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.679918:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x212:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.679923:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.679932:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.679950:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+90:2364:x1868940985119744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 295us (469us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.679957:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.679961:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 118
00000100:00100000:1.0:1782361985.679983:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+91:2365:x1868940985119872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 160us (434us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.679993:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 119
00010000:00010000:1.0:1782361985.680022:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680028:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680034:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680040:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680060:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680068:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680089:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.680122:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680130:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680239:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.680246:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680267:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.680271:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680281:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680295:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680303:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ea24 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x212:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680324:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.680328:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.680330:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.680345:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.680480:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680494:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 90 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680497:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680510:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x211:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.680516:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x211:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.680521:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 89 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680522:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680543:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x210:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.680548:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.680558:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680565:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 90 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.680580:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 90 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.680584:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 89 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.680602:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362112:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.680605:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 89 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.680623:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362240:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.680678:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.680742:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.680748:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680756:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.680759:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680815:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680844:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680852:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7ea1d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.680868:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.680870:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.680878:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.680949:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.681963:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e503ea4000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362112:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.681977:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.681986:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.682067:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120000
00000100:00100000:3.0:1782361985.682073:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120000
00010000:00010000:3.0:1782361985.682096:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 91 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.682130:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 120
00000100:00100000:3.0:1782361985.682139:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+91:2364:x1868940985120000:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.682149:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.682155:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 91 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.682166:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 91 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.682241:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007e582ca0/0x57e58d5a90c7d65f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cdb expref: 91 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.682252:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x211:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.682257:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x211:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.682261:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.682271:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.682296:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.682313:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682323:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682329:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682333:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.682344:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+90:2364:x1868940985120000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 203us (361us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.682344:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362240:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.682346:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1782361985.682357:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 120
00010000:00010000:2.0:1782361985.682359:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682375:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.682380:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682386:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.682389:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682402:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682618:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682625:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ea2b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x211:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682636:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682643:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.682650:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 89 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682651:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.682655:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.682661:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x210:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.682665:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.682674:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.682691:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.682698:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 89 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682710:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 89 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.682722:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362368:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.682725:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120128
00000100:00100000:2.0:1782361985.682731:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120128
00010000:00010000:2.0:1782361985.682750:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 90 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.682782:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 121
00000100:00100000:0.0:1782361985.682798:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ec00 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.682806:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+90:2364:x1868940985120128:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.682817:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.682822:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 90 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682867:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 90 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682893:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff4192bd/0x57e58d5a90c7d627 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cc6 expref: 90 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682900:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.682903:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.682905:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682910:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.682921:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.682944:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+89:2364:x1868940985120128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 142us (256us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.682947:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.682951:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 121
00010000:00010000:0.0:1782361985.682961:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682971:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682978:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.682994:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.683015:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.683021:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.683084:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.683106:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.683112:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.683123:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.683135:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.683166:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 88 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.683181:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea32 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.683182:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20f:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.683189:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.683198:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.683206:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.683210:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.683212:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.683221:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 88 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.683231:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 88 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.683242:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362496:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.683285:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e509372900 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.683942:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362368:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.683956:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.684080:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.684105:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120256
00000100:00100000:3.0:1782361985.684141:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120256
00010000:00010000:3.0:1782361985.684160:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 90 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.684205:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 122
00000100:00100000:3.0:1782361985.684266:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+90:2364:x1868940985120256:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.684275:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.684280:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 90 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684290:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 90 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684302:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013ef4d1b/0x57e58d5a90c7d5ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2cb1 expref: 90 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684312:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.684316:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x210:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.684320:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684329:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.684334:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.684354:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.684371:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120384
00000100:00100000:2.0:1782361985.684376:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120384
00000100:00100000:3.0:1782361985.684391:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+89:2364:x1868940985120256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 128us (311us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.684393:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 89 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.684407:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 122
00000100:00100000:3.0:1782361985.684437:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 123
00000100:00100000:3.0:1782361985.684446:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+89:2364:x1868940985120384:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.684454:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.684461:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 89 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684471:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 89 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.684478:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362496:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.684488:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000020fd445e/0x57e58d5a90c7d5b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c9c expref: 89 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684497:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.684501:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.684505:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.684512:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685259:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.685275:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.685288:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685296:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685306:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.685309:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+88:2364:x1868940985120384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 863us (975us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.685325:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.685326:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 123
00010000:00010000:0.0:1782361985.685349:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.685372:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.685379:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685389:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.685393:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685504:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685516:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685524:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ea40 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685540:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.685543:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.685546:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.685572:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685586:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 87 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685594:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20e:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.685597:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.685602:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685623:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 87 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685642:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 87 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.685654:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362624:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.685796:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5093726c0 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.685815:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685824:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685909:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685918:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.685934:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.685960:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.685967:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685976:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.685980:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.685989:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.686002:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.686022:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x210:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.686041:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.686043:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.686046:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.686270:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.686282:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 88 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.686288:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20f:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.686297:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.686301:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.686319:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 88 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.686325:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 88 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.686333:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362752:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.686364:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5087f2b40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.686721:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362624:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.686732:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.687715:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.687803:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992362752:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.687819:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.687965:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.688131:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120512
00000100:00100000:0.0:1782361985.688137:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120512
00010000:00010000:0.0:1782361985.688162:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 88 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.688190:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120640
00000100:00100000:0.0:1782361985.688198:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120640
00010000:00010000:0.0:1782361985.688208:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 89 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.688229:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 124
00000100:00100000:0.0:1782361985.688237:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+88:2365:x1868940985120512:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.688248:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 125
00010000:00010000:0.0:1782361985.688248:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.688253:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 88 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.688256:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+89:2365:x1868940985120640:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.688263:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.688264:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 88 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688267:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 89 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688276:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 89 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688280:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000058c6dc01/0x57e58d5a90c7d547 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c72 expref: 88 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688289:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002c672fcc/0x57e58d5a90c7d57f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c87 expref: 89 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688291:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.688295:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.688298:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.688299:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688300:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20f:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.688305:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688308:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688312:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688326:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.688338:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.688354:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+88:2365:x1868940985120640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 99us (389us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.688354:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f77450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+87:2365:x1868940985120512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (640us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.688362:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 125
00000100:00100000:0.0:1782361985.688368:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 124
00010000:00010000:0.0:1782361985.688402:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688411:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688419:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688428:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688441:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688449:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688450:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.688457:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688463:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688472:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.688563:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688576:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 86 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688582:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20d:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.688585:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.688589:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688609:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 86 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.688625:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 86 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.688637:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362880:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.688681:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e503f8a300 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.688709:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688721:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 87 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688727:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20e:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.688730:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.688739:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688758:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 87 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.688767:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 87 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.688777:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53d900700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363008:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.688820:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a780 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.688874:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1782361985.688881:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688891:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.688896:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688906:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688918:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688925:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ea47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688974:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.688978:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.688991:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.688994:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.689002:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.689013:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.689020:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ea4e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.689032:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.689034:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.689036:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.690216:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992362880:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.690232:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.690278:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53d900700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363008:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.690292:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.690559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.690578:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.690611:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120768
00000100:00100000:0.0:1782361985.690626:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120768
00010000:00010000:0.0:1782361985.690648:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 88 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.690673:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985120896
00000100:00100000:0.0:1782361985.690677:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985120896
00000100:00100000:1.0:1782361985.690689:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 126
00010000:00010000:0.0:1782361985.690689:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 87 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.690700:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+88:2364:x1868940985120768:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.690709:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.690715:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 88 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.690718:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 127
00010000:00010000:1.0:1782361985.690730:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 88 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.690734:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+87:2364:x1868940985120896:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.690748:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.690750:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001cc2ad30/0x57e58d5a90c7d50f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c5d expref: 88 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.690757:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 87 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.690760:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.690770:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20e:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.690776:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.690798:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.690803:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 87 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.690817:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.690822:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b1a6e7f/0x57e58d5a90c7d4d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c48 expref: 87 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.690859:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.690865:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+87:2364:x1868940985120768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 164us (303us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.690876:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.690882:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 126
00010000:00010000:3.0:1782361985.690904:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.690912:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.690930:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.690942:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.690948:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.690955:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.690959:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.690964:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.691024:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691038:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691046:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ea5c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691063:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.691072:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.691074:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.691237:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691255:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 86 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691262:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20d:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.691265:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.691269:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691288:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 86 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691299:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 86 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.691309:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363136:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.691353:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.691427:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.691433:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.691438:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.691447:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.691474:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.691502:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+86:2364:x1868940985120896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 772us (920us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.691510:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 127
00010000:00010000:2.0:1782361985.691820:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691859:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691868:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691888:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.691905:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.691935:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.691940:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691948:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.691951:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691960:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691972:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691979:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ea55 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691992:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.691993:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.691993:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.691995:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.692005:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 85 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.692013:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20c:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.692016:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.692020:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.692039:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 85 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.692047:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 85 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.692058:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363264:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.692097:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.692276:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363136:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.692290:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.692885:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.692962:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121024
00000100:00100000:3.0:1782361985.693006:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121024
00010000:00010000:3.0:1782361985.693029:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 87 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.693064:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 128
00000100:00100000:2.0:1782361985.693072:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3cb800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363264:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.693074:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+87:2365:x1868940985121024:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.693098:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693131:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.693138:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 87 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693150:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 87 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693178:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d448f19b/0x57e58d5a90c7d49f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c33 expref: 87 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.693187:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.693196:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.693200:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20d:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.693205:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693214:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.693239:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121152
00010000:00010000:3.0:1782361985.693241:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.693245:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121152
00010000:00010000:2.0:1782361985.693253:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693262:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.693269:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 86 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693273:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.693285:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+86:2365:x1868940985121024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 210us (398us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.693289:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.693303:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129
00000100:00100000:1.0:1782361985.693311:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+86:2365:x1868940985121152:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.693318:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1782361985.693322:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 128
00010000:00010000:2.0:1782361985.693322:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.693325:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 86 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.693337:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 86 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693350:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.693350:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037910d77/0x57e58d5a90c7d467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c1e expref: 86 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693356:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693375:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.693376:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.693380:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.693380:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.693392:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693395:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.693413:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693418:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693431:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ea63 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.693449:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.693460:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.693463:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.693467:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.693475:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.693482:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+85:2365:x1868940985121152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (297us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.693494:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.693499:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129
00010000:00010000:0.0:1782361985.693510:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693528:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693549:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.693631:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693645:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 85 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693650:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20c:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.693653:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.693656:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693668:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693680:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 85 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693684:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 84 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.693694:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 85 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693698:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20b:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.693705:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20b:0x0].0x0 since=0s v=(1 0)
00000100:00100000:2.0:1782361985.693707:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363392:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.693711:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693730:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.693737:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.693738:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 84 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.693743:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d43c0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.693759:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.693763:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 84 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693771:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.693783:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363520:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.693785:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.693818:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.693856:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e503f8a780 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.694360:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ea6a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.694376:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.694378:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.694429:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.694564:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363392:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.694578:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.694925:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.695023:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363520:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.695034:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121280
00000100:00100000:0.0:1782361985.695039:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121280
00010000:00010000:2.0:1782361985.695040:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695062:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 86 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.695094:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 130
00000100:00100000:0.0:1782361985.695101:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+86:2364:x1868940985121280:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.695111:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.695116:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 86 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695128:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 86 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695143:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b3f5f725/0x57e58d5a90c7d42f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2c09 expref: 86 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695152:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.695156:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20c:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.695161:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695168:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.695242:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.695267:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121408
00000100:00100000:3.0:1782361985.695273:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121408
00010000:00010000:0.0:1782361985.695282:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.695283:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695293:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 85 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695297:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695317:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.695331:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131
00010000:00010000:2.0:1782361985.695332:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.695340:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+85:2364:x1868940985121280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 236us (413us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.695345:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503f74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+85:2364:x1868940985121408:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.695356:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 130
00010000:00010000:3.0:1782361985.695360:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.695362:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.695369:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 85 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695385:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 85 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695385:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.695391:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695399:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.695410:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695421:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695422:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000066995bde/0x57e58d5a90c7d3f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bf4 expref: 85 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695447:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.695448:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695454:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.695466:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695466:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea71 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.695489:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695502:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.695504:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.695506:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.695516:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.695538:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695548:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.695556:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503f74050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+84:2364:x1868940985121408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 215us (311us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.695560:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.695570:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131
00010000:00010000:0.0:1782361985.695571:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695590:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.695715:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695728:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 83 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695737:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x20a:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.695740:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.695744:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695765:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 83 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695783:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 83 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695815:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.695816:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363648:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.695865:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 84 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.695873:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20b:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.695877:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.695881:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.695884:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e503f8a300 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.695899:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.695906:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 84 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695906:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695927:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.695928:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 84 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695932:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.695946:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363776:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.695948:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695964:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.695972:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ea78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.695973:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d43c0 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.695991:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.695993:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.695995:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.697259:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363648:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.697273:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.697315:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992363776:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.697329:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.697752:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.697774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.697810:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121664
00000100:00100000:3.0:1782361985.697814:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121536
00000100:00100000:0.0:1782361985.697816:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121664
00000100:00100000:3.0:1782361985.697819:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121536
00010000:00010000:3.0:1782361985.697859:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 84 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.697875:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 85 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.697893:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 132
00000100:00100000:3.0:1782361985.697904:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+84:2364:x1868940985121536:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.697904:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 133
00000100:00100000:1.0:1782361985.697914:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+85:2362:x1868940985121664:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.697915:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.697920:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 84 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.697921:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.697926:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 85 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.697936:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 85 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.697943:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 84 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.697961:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a55aa2a7/0x57e58d5a90c7d387 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bca expref: 84 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.697961:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000030a15a7e/0x57e58d5a90c7d3bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bdf expref: 85 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.697974:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.697974:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.697978:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.697978:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20b:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.697983:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.697983:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.697993:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.697993:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698013:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.698019:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.698036:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698041:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.698049:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+83:2364:x1868940985121536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 145us (270us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.698049:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+84:2362:x1868940985121664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 135us (294us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.698054:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.698068:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 133
00010000:00010000:2.0:1782361985.698074:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.698075:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 132
00010000:00010000:0.0:1782361985.698077:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.698092:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698099:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698110:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.698112:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.698123:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.698133:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.698135:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698145:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.698150:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698177:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698232:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698242:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ea7f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698262:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.698265:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698267:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698288:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.698292:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 82 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698294:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698315:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.698338:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x209:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.698343:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.698343:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.698352:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698354:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ea86 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698387:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.698390:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.698390:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 82 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.698393:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.698401:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.698408:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 82 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698413:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.698425:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363904:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.698432:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 83 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698440:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x20a:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.698444:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.698448:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.698468:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 83 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.698477:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e503f8a780 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.698478:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 83 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.698497:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364032:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.698531:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.699327:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992363904:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.699340:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.699579:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364032:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.699595:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.699595:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.699776:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121792
00000100:00100000:3.0:1782361985.699781:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121792
00010000:00010000:3.0:1782361985.699809:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 83 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.699817:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.699868:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985121920
00000100:00100000:3.0:1782361985.699873:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985121920
00000100:00100000:0.0:1782361985.699882:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 134
00010000:00010000:3.0:1782361985.699888:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 84 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.699898:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+83:2365:x1868940985121792:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.699909:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.699915:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 83 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.699918:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 135
00000100:00100000:3.0:1782361985.699929:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+84:2365:x1868940985121920:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.699939:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.699944:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 84 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.699948:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 83 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.699955:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 84 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.699972:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa2c81f6/0x57e58d5a90c7d317 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ba0 expref: 83 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.699973:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007052128a/0x57e58d5a90c7d34f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2bb5 expref: 84 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.699995:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.700000:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.700002:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.700005:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.700006:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20a:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.700011:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.700025:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700025:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.700062:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.700069:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.700093:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.700102:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074da300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+83:2365:x1868940985121920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (281us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.700102:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+82:2365:x1868940985121792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 205us (504us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.700111:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.700121:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 134
00010000:00010000:2.0:1782361985.700130:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.700131:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 135
00010000:00010000:2.0:1782361985.700142:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.700162:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.700173:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.700184:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700184:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.700192:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.700196:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700209:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.700212:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700216:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700244:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700256:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700262:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.700264:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ea8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700269:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.700278:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700282:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.700282:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.700286:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.700290:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.700290:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.700298:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 81 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.700305:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x208:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.700310:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.700319:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.700320:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700344:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.700349:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 81 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700359:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.700363:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.700364:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 81 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.700367:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.700375:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364160:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.700421:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.700782:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool
00010000:00010000:3.0:1782361985.700803:0:14579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ea94 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.701116:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.701129:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 82 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.701136:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x209:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.701139:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.701143:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.701163:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 82 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.701170:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 82 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.701186:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364288:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.701219:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.701821:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364160:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.701866:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.702452:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.702544:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122048
00000100:00100000:0.0:1782361985.702550:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122048
00000100:00100000:2.0:1782361985.702588:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364288:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.702590:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 82 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.702606:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.702634:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 136
00000100:00100000:0.0:1782361985.702645:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+82:2364:x1868940985122048:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.702656:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.702661:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 82 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702673:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 82 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702704:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d248d51/0x57e58d5a90c7d2a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b76 expref: 82 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702716:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.702719:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.702724:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702733:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702756:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.702798:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.702808:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074db480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+81:2364:x1868940985122048:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 162us (354us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.702813:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.702820:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 136
00010000:00010000:2.0:1782361985.702864:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.702874:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.702895:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.702978:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.702985:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.702993:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.702998:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703008:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.703023:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.703023:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703040:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703047:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 80 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703053:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ea9b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703057:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x207:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.703067:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.703073:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703082:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.703087:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.703091:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.703093:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122176
00000100:00100000:1.0:1782361985.703098:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122176
00010000:00010000:2.0:1782361985.703099:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 80 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703112:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 80 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.703116:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 83 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.703134:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364416:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.703148:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 137
00000100:00100000:1.0:1782361985.703155:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+83:2365:x1868940985122176:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.703162:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.703166:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 83 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.703178:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 83 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.703191:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.703202:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000019d62473/0x57e58d5a90c7d2df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b8b expref: 83 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.703221:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.703225:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x209:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.703237:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.703246:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.703267:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.703292:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+82:2365:x1868940985122176:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 136us (271us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.703294:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.703304:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 137
00010000:00010000:2.0:1782361985.703306:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703313:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703327:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703340:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.703358:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.703363:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703368:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.703371:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703377:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703385:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703390:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7eaa2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x209:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.703412:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.703413:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.703415:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.703571:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703582:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 81 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703590:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x208:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.703593:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.703596:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703615:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 81 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.703625:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 81 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.703634:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364544:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.703658:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4180 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.703941:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364416:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.703962:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.704245:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.704286:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122304
00000100:00100000:0.0:1782361985.704291:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122304
00010000:00010000:0.0:1782361985.704305:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 81 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.704324:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 138
00000100:00100000:0.0:1782361985.704332:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504753450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+81:2365:x1868940985122304:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.704340:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.704345:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 81 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704360:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 81 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704373:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003fda61e9/0x57e58d5a90c7d237 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b4c expref: 81 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704382:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.704385:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.704389:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704409:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704435:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.704461:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504753450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+80:2365:x1868940985122304:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 130us (218us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.704470:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 138
00010000:00010000:2.0:1782361985.704644:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704651:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704657:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704661:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704673:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.704696:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.704702:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704710:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.704713:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704722:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704733:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704740:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7eaa9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.704757:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.704764:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.704767:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.704813:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704851:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 79 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704859:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x206:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.704862:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.704867:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704894:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 79 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.704900:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 79 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.704907:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364672:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.704943:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.705079:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364544:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.705097:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.705359:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.705398:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122432
00000100:00100000:1.0:1782361985.705404:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122432
00010000:00010000:1.0:1782361985.705422:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 82 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.705489:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 139
00000100:00100000:1.0:1782361985.705498:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+82:2365:x1868940985122432:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.705507:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.705512:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 82 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705524:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 82 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705550:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053835152/0x57e58d5a90c7d26f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b61 expref: 82 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705560:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.705564:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x208:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.705569:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705577:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705600:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.705636:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+81:2365:x1868940985122432:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 139us (277us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.705644:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 139
00010000:00010000:2.0:1782361985.705699:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.705709:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.705718:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.705725:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.705755:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.705784:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.705802:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705811:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.705815:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705824:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705880:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705887:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7eab0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x208:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.705905:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.705907:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.705910:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.706012:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.706024:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 80 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.706031:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x207:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.706035:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.706038:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 4/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.706070:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 80 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.706079:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 80 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.706090:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364800:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.706126:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.707956:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364800:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.707976:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.708098:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.708149:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122688
00000100:00100000:1.0:1782361985.708156:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122688
00000100:00100000:2.0:1782361985.708157:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992364672:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.708171:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708187:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 81 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.708229:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 140
00000100:00100000:1.0:1782361985.708252:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+81:2363:x1868940985122688:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.708263:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.708270:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 81 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708283:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 81 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.708288:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.708308:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001f59b63f/0x57e58d5a90c7d1ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b37 expref: 81 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.708326:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122560
00000100:00100000:0.0:1782361985.708332:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122560
00010000:00010000:1.0:1782361985.708333:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.708338:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x207:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.708343:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708353:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 80 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708355:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708391:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.708400:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 141
00010000:00010000:3.0:1782361985.708403:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.708412:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+80:2365:x1868940985122560:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.708419:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708425:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1782361985.708433:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+80:2363:x1868940985122688:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 183us (333us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.708434:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 80 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.708451:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 140
00010000:00010000:0.0:1782361985.708467:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 80 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708483:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c190edbc/0x57e58d5a90c7d1c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b22 expref: 80 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708493:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708494:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.708501:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.708510:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708512:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708534:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708572:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.708590:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.708602:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+79:2365:x1868940985122560:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 194us (317us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.708603:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.708611:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.708616:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 141
00010000:00010000:3.0:1782361985.708637:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.708648:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708650:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708666:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708672:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708677:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708692:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 1/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708692:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.708716:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eabe lrc: 0/0,0 mode: --/PW res: [0x240000400:0x207:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708726:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.708744:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.708752:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708761:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.708765:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708771:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708781:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708785:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7eab7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.708812:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.708815:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.708816:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.708822:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.708824:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.708858:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.708955:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.708958:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.708982:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 79 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.708986:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 78 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.708991:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x206:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.708999:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.709002:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x205:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.709005:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 4/0,1 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.709008:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.709017:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.709037:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 79 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.709044:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 78 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.709054:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 79 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.709061:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 78 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.709068:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364928:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.709082:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365056:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.709114:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.709172:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.710870:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.710905:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122816
00000100:00100000:1.0:1782361985.710910:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122816
00010000:00010000:1.0:1782361985.710935:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 80 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.710939:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365056:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.710969:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 142
00000100:00100000:1.0:1782361985.710977:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+80:2364:x1868940985122816:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.710995:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.711000:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 80 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711013:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 80 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.711020:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711030:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711035:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x206:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711040:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711049:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711064:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.711064:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.711090:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+80:2364:x1868940985122816:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (224us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.711097:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 142
00000100:00100000:1.0:1782361985.711183:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985122944
00000100:00100000:1.0:1782361985.711188:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985122944
00010000:00010000:1.0:1782361985.711202:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 79 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.711225:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 143
00000100:00100000:1.0:1782361985.711231:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+79:2365:x1868940985122944:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.711247:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.711252:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 79 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711263:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 79 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711276:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000542002aa/0x57e58d5a90c7d157 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2af8 expref: 79 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711293:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711296:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711300:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711307:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711324:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.711332:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.711341:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.711349:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.711351:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+78:2365:x1868940985122944:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 120us (287us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.711357:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 143
00010000:00010000:3.0:1782361985.711366:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.711382:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.711391:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.711395:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711412:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.711416:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711426:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711436:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711443:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7eac5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711470:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.711471:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.711473:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.711517:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711529:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 77 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711536:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x204:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.711540:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711544:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711569:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 77 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711580:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 77 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.711592:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365184:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.711626:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.711649:0:14579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000284ccedf/0x57e58d5a90c7d18f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2b0d expref: 79 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.711656:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992364928:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.711666:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711672:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711676:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711681:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711693:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711711:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.711871:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.711878:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.711888:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.711892:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.711900:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.711914:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.711922:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eacc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x206:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.711942:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.711944:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.711947:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.711958:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711968:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 78 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.711975:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x205:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.711977:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.711981:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 4/0,1 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.712000:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 78 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.712009:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 78 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.712019:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365312:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.712058:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.712451:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365184:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.712472:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.712941:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365312:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.712951:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.713089:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.713132:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123072
00000100:00100000:0.0:1782361985.713139:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123072
00010000:00010000:0.0:1782361985.713161:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 78 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713193:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 144
00000100:00100000:0.0:1782361985.713207:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+78:2364:x1868940985123072:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.713216:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.713222:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 78 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713234:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 78 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713248:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000087b9f376/0x57e58d5a90c7d0e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ace expref: 78 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713259:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.713264:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.713268:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713277:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713306:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.713320:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.713337:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+77:2364:x1868940985123072:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (246us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.713341:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713346:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 144
00010000:00010000:2.0:1782361985.713357:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.713367:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713369:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123200
00000100:00100000:0.0:1782361985.713375:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123200
00010000:00010000:2.0:1782361985.713386:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713389:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 79 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.713413:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.713430:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.713437:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713445:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 145
00010000:00010000:1.0:1782361985.713453:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.713457:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713458:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504750050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+79:2364:x1868940985123200:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.713471:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713473:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.713482:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 79 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713492:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713497:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 79 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713514:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ead3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713523:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000757cef5d/0x57e58d5a90c7d11f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ae3 expref: 79 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713538:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.713542:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.713542:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x205:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.713545:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.713549:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.713550:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.713558:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713560:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.713576:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 76 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713592:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.713597:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x203:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.713602:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.713606:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.713619:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504750050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+78:2364:x1868940985123200:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 163us (299us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.713626:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 145
00010000:00010000:2.0:1782361985.713638:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 76 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.713660:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 76 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.713674:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365440:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.713722:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.713795:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713817:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713856:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713866:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.713883:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.713910:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.713916:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713924:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.713928:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713936:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713947:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 1/0,0 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713955:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7eada lrc: 0/0,0 mode: --/PW res: [0x240000400:0x205:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.713971:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.713973:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.713975:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.714102:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.714116:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 77 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.714123:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x204:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.714127:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.714131:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.714151:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 77 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.714160:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 77 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.714177:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365568:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.714226:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.714583:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365440:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.714597:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.715000:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.715047:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123328
00000100:00100000:2.0:1782361985.715053:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123328
00010000:00010000:2.0:1782361985.715073:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 77 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.715102:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 146
00000100:00100000:2.0:1782361985.715111:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+77:2364:x1868940985123328:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.715119:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.715124:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 77 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715135:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 77 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715149:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cca25fa8/0x57e58d5a90c7d077 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2aa4 expref: 77 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715166:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.715170:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.715174:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715182:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715210:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.715244:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+76:2364:x1868940985123328:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 133us (242us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.715247:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.715255:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 146
00010000:00010000:1.0:1782361985.715258:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715265:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715270:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715283:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.715291:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.715298:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715308:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.715313:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715328:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715343:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715351:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715362:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715366:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.715369:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.715374:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.715375:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 75 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715381:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x202:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.715383:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x202:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.715387:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 4/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.715408:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365568:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.715416:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.715418:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 75 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715430:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.715444:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 75 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.715456:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365696:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.715497:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.715516:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123456
00000100:00100000:3.0:1782361985.715522:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123456
00010000:00010000:3.0:1782361985.715542:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 78 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.715572:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 147
00000100:00100000:3.0:1782361985.715580:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+78:2365:x1868940985123456:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.715588:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.715593:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 78 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.715604:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 78 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.715620:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000091322855/0x57e58d5a90c7d0af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2ab9 expref: 78 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.715630:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.715633:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x204:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.715638:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.715652:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.715673:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.715698:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.715704:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+77:2365:x1868940985123456:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 124us (291us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.715717:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.715718:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 147
00010000:00010000:2.0:1782361985.715731:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715752:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.715769:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.715794:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.715800:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715808:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.715812:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715821:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715867:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715882:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eae8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x204:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.715904:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.715906:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.715908:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.716030:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.716043:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 76 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.716050:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x203:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.716053:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.716057:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.716075:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 76 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.716084:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 76 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.716095:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365824:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.716135:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.716389:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074daa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365696:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.716401:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.716849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.716906:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123584
00000100:00100000:0.0:1782361985.716911:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123584
00010000:00010000:0.0:1782361985.716928:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 76 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.716955:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 148
00000100:00100000:0.0:1782361985.716963:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+76:2364:x1868940985123584:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.716970:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.716975:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 76 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.716987:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 76 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717002:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006221c813/0x57e58d5a90c7d007 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a7a expref: 76 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717014:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x202:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.717017:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x202:0x0].0x0 since=0s v=(1 0)
00000100:00100000:2.0:1782361985.717027:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992365824:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.717027:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717040:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717059:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717069:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.717086:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717094:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717102:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+75:2364:x1868940985123584:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 137us (271us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.717104:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717114:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 148
00010000:00010000:1.0:1782361985.717115:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.717133:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.717149:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.717160:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.717165:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717176:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123712
00010000:00010000:1.0:1782361985.717179:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00000100:00100000:0.0:1782361985.717181:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123712
00010000:00010000:1.0:1782361985.717184:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717196:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 77 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717211:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717227:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 1/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717230:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 149
00010000:00010000:1.0:1782361985.717241:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eaef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717246:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+77:2365:x1868940985123712:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.717259:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.717261:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.717264:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 77 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717265:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.717267:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.717278:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 77 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717292:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009592ca76/0x57e58d5a90c7d03f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a8f expref: 77 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717311:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.717315:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x203:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.717319:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717326:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717340:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717345:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.717351:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 74 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717366:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717366:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x201:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.717371:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.717379:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717381:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+76:2365:x1868940985123712:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 140us (250us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.717391:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.717399:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 149
00010000:00010000:2.0:1782361985.717410:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.717414:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 74 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717427:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717446:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.717447:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 74 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.717463:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365952:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.717523:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.717676:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717689:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 75 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717692:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.717699:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717701:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x202:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.717709:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x202:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.717717:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.717719:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717724:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717736:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717759:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717769:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 75 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.717802:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eaf6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x203:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.717807:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 75 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.717826:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366080:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.717884:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4300 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.717912:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.717915:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.717917:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.718295:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992365952:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.718305:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.718775:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.718818:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123840
00000100:00100000:1.0:1782361985.718824:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123840
00010000:00010000:1.0:1782361985.718874:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 75 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.718900:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 150
00000100:00100000:1.0:1782361985.718909:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+75:2364:x1868940985123840:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.718930:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.718935:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 75 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.718944:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 75 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.718954:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e27e998e/0x57e58d5a90c7cf97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a50 expref: 75 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.718964:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.718967:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.718972:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.718980:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.719003:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.719030:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+74:2364:x1868940985123840:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 123us (256us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.719035:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 150
00010000:00010000:3.0:1782361985.719182:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719190:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719196:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719202:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719215:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.719247:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.719254:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719266:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.719270:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719280:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719292:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719299:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7eafd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719316:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.719319:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.719327:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.719397:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.719405:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.719432:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 73 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719440:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x200:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.719443:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.719447:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.719469:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 73 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.719476:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985123968
00010000:00010000:3.0:1782361985.719481:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 73 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.719482:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985123968
00000100:00100000:3.0:1782361985.719497:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366208:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.719504:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 76 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.719538:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 151
00000100:00100000:3.0:1782361985.719543:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835d80 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.719547:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+76:2365:x1868940985123968:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.719556:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.719561:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 76 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719571:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 76 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719584:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x202:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.719587:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x202:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.719591:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719598:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.719612:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.719631:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074dad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+76:2365:x1868940985123968:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 86us (231us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.719637:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 151
00010000:00010000:2.0:1782361985.719881:0:14579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000729965a1/0x57e58d5a90c7cfcf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a65 expref: 75 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.719895:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366080:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.719910:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.719919:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.719928:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.719937:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.719956:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.719974:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.720001:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.720008:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.720016:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.720020:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.720030:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.720042:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.720050:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb04 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x202:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.720069:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.720071:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.720073:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.720195:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.720208:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 74 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.720214:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x201:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.720217:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.720220:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.720239:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 74 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.720249:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 74 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.720260:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366336:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.720298:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.721333:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366208:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.721352:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.721362:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721400:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124096
00000100:00100000:0.0:1782361985.721406:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124096
00000100:00100000:2.0:1782361985.721420:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366336:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.721430:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 74 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.721456:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721479:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 152
00000100:00100000:0.0:1782361985.721489:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504752050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+74:2365:x1868940985124096:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.721507:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.721513:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 74 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721524:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 74 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721539:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009e31fd8/0x57e58d5a90c7cf27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a26 expref: 74 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721549:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.721553:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.721557:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721565:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721578:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.721594:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.721606:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.721621:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721622:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504752050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+73:2365:x1868940985124096:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 132us (270us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.721635:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 152
00010000:00010000:3.0:1782361985.721646:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.721647:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.721668:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.721675:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:0.0:1782361985.721679:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124224
00000100:00100000:0.0:1782361985.721684:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124224
00010000:00010000:1.0:1782361985.721690:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.721700:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.721702:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 75 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.721707:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.721719:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.721736:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.721744:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bf99f17/0x57e58d5a90c7eb0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721752:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 153
00000100:00100000:0.0:1782361985.721762:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+75:2362:x1868940985124224:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.721766:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.721769:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.721770:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.721772:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.721777:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 75 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721802:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 75 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721816:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000875e1bc2/0x57e58d5a90c7cf5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a3b expref: 75 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721825:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.721851:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x201:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.721856:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721864:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721881:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.721900:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721907:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+74:2362:x1868940985124224:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 146us (261us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.721919:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.721921:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 153
00010000:00010000:3.0:1782361985.721933:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.721942:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.721958:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.721970:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.721976:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721983:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.721987:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.721996:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.722008:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.722016:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eb12 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x201:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.722031:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.722034:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.722036:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.722064:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.722081:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 72 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.722089:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ff:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.722092:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.722097:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.722124:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 72 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.722137:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 72 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.722152:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366464:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.722207:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.722402:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.722414:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 73 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.722432:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x200:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.722435:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.722438:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.722457:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 73 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.722465:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 73 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.722475:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366592:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.722516:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5087f2780 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.723367:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366464:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.723385:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.723678:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.723714:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124352
00000100:00100000:2.0:1782361985.723721:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124352
00010000:00010000:2.0:1782361985.723744:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 73 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.723778:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 154
00000100:00100000:2.0:1782361985.723799:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+73:2365:x1868940985124352:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.723809:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.723814:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 73 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.723825:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 73 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.723874:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ceb7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29fc expref: 73 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.723885:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.723889:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.723893:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.723902:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.723934:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.723955:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.723966:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.723974:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+72:2365:x1868940985124352:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 186us (294us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.723979:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.723984:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 154
00010000:00010000:1.0:1782361985.723997:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.724111:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.724234:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.724249:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 71 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.724257:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1fe:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.724260:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.724264:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.724286:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 71 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.724297:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 71 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.724310:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366720:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.724392:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a780 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.724821:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.724840:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.724850:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.724855:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.724875:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.724888:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.724894:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7eb19 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.724911:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.724913:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.724916:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.725227:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366592:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.725242:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.725768:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.725934:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.725949:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366720:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.725959:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.726080:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124480
00000100:00100000:0.0:1782361985.726080:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124608
00000100:00100000:0.0:1782361985.726086:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124608
00000100:00100000:1.0:1782361985.726087:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124480
00010000:00010000:0.0:1782361985.726105:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 72 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726115:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 74 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.726132:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 155
00000100:00100000:0.0:1782361985.726138:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+72:2364:x1868940985124608:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.726144:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.726147:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 72 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726154:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 72 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726171:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a40e0eb5/0x57e58d5a90c7ce47 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29d2 expref: 72 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726178:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.726180:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.726186:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726192:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726205:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.726235:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+71:2364:x1868940985124608:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 97us (302us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.726243:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 155
00000100:00100000:1.0:1782361985.726250:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 156
00000100:00100000:1.0:1782361985.726260:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+74:2364:x1868940985124480:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.726270:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.726275:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 74 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726288:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 74 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726303:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c0d2c061/0x57e58d5a90c7ceef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2a11 expref: 74 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726315:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.726325:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x200:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.726329:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726337:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726367:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.726390:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+73:2364:x1868940985124480:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 132us (622us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.726400:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 156
00010000:00010000:0.0:1782361985.726524:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726531:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726537:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.726543:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726624:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726633:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726641:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726648:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726662:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.726683:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.726690:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726698:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.726703:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726711:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726724:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726731:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7eb27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.726751:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.726753:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.726755:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.726760:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726769:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 70 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726778:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1fd:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.726781:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.726783:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726812:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 70 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.726824:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 70 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.726864:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366848:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.726911:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.726971:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.726983:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.726989:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.727002:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.727006:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.727025:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.727039:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.727047:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d94b7e31/0x57e58d5a90c7eb20 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x200:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.727065:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.727067:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.727070:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.727246:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.727258:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 72 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.727264:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ff:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.727267:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.727271:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.727288:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 72 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.727298:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 72 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.727308:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366976:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.727341:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e507835180 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.727725:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992366848:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.727740:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.728058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.728094:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124736
00000100:00100000:2.0:1782361985.728100:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124736
00010000:00010000:2.0:1782361985.728122:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 71 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.728150:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 157
00000100:00100000:2.0:1782361985.728157:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+71:2364:x1868940985124736:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.728173:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.728179:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 71 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728190:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 71 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728202:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000076342eb3/0x57e58d5a90c7cdd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29a8 expref: 71 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728210:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.728212:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.728215:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728220:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728237:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.728258:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.728262:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+70:2364:x1868940985124736:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 105us (204us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.728275:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 157
00010000:00010000:0.0:1782361985.728279:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.728301:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.728310:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.728331:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.728358:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.728364:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728370:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.728373:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728379:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728389:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728399:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7eb2e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728419:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.728421:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.728422:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.728492:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.728505:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 69 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.728511:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1fc:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.728513:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.728516:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.728524:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.728538:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 69 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.728543:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992366976:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.728550:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 69 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.728560:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367104:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.728565:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124864
00000100:00100000:2.0:1782361985.728570:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124864
00010000:00010000:1.0:1782361985.728576:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728589:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 73 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.728613:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.728630:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 158
00000100:00100000:2.0:1782361985.728642:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+73:2364:x1868940985124864:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.728651:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.728656:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 73 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728668:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 73 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728682:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037122b0a/0x57e58d5a90c7ce7f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29e7 expref: 73 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728692:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.728695:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ff:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.728699:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728707:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728727:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.728746:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.728752:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+72:2364:x1868940985124864:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 111us (232us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.728764:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 158
00010000:00010000:1.0:1782361985.728764:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728779:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728797:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.728815:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.728849:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.728855:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728863:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.728867:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728875:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728886:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728893:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7eb35 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ff:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.728905:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.728906:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.728908:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.729108:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.729131:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 71 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.729137:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1fe:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.729140:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.729144:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.729162:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 71 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.729171:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 71 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.729181:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367232:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.729232:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1af00 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.730028:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367104:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.730044:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.730289:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367232:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.730300:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.730425:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.730465:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.730483:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125120
00000100:00100000:1.0:1782361985.730488:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125120
00010000:00010000:1.0:1782361985.730508:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 72 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.730511:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985124992
00000100:00100000:0.0:1782361985.730517:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985124992
00010000:00010000:0.0:1782361985.730539:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 70 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.730558:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 159
00000100:00100000:1.0:1782361985.730571:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504750450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+72:2365:x1868940985125120:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.730575:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 160
00000100:00100000:0.0:1782361985.730588:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+70:2364:x1868940985124992:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.730597:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.730598:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.730609:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 72 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730609:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 70 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730633:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 72 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730639:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 70 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730656:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005f68bcbe/0x57e58d5a90c7ce0f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb29bd expref: 72 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730660:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fd5c64d/0x57e58d5a90c7cd67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb297e expref: 70 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730669:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.730673:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fe:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.730674:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.730676:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730679:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.730685:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730688:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730708:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.730710:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730728:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730735:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.730736:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504750450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+71:2365:x1868940985125120:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 167us (310us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.730749:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.730749:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 159
00000100:00100000:0.0:1782361985.730762:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+69:2364:x1868940985124992:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 177us (297us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.730763:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.730774:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 160
00010000:00010000:2.0:1782361985.730784:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730816:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.730820:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730849:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730858:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730866:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.730882:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1782361985.730889:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.730897:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730906:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.730911:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.730911:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730919:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730924:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730931:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.730937:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730945:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730948:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730966:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb43 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730972:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.730981:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004fbb25c2/0x57e58d5a90c7eb3c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.730994:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.730998:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.731001:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.731002:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.731006:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.731008:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.731010:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.731024:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 68 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.731042:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1fb:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.731046:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.731049:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.731072:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 68 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.731085:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 68 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.731096:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367360:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.731148:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.731296:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.731314:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 70 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.731323:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1fd:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.731326:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.731330:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.731350:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 70 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.731360:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 70 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.731371:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367488:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.731404:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d43c0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.732367:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367360:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.732383:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.732771:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367488:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.732797:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.732964:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.732995:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125376
00000100:00100000:2.0:1782361985.733000:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125376
00000100:00100000:3.0:1782361985.733005:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.733022:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 71 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.733051:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125248
00000100:00100000:2.0:1782361985.733053:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125248
00010000:00010000:2.0:1782361985.733063:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 69 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.733068:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 161
00000100:00100000:3.0:1782361985.733083:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+71:2365:x1868940985125376:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1782361985.733092:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 162
00010000:00010000:3.0:1782361985.733095:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1782361985.733101:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+69:2364:x1868940985125248:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.733105:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 71 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733109:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.733118:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 69 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733124:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 71 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733141:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 69 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733149:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb43cab/0x57e58d5a90c7cd9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2993 expref: 71 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733168:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.733172:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.733176:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733179:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000095192a40/0x57e58d5a90c7ccf7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2954 expref: 69 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733191:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733197:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.733202:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.733207:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733214:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733216:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.733233:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.733244:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.733250:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+70:2365:x1868940985125376:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (284us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.733252:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.733259:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.733262:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 161
00010000:00010000:1.0:1782361985.733276:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.733282:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+68:2364:x1868940985125248:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 180us (276us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.733297:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 162
00010000:00010000:1.0:1782361985.733311:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.733338:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733347:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733356:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733364:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733383:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.733410:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1782361985.733417:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733426:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.733431:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733453:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733468:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733477:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7eb51 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733496:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.733498:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733504:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.733507:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733513:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733521:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733526:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb4a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733529:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.733545:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.733557:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.733560:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 67 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.733560:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.733564:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.733572:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1fa:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.733576:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.733586:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733612:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 67 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.733619:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.733625:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 67 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.733638:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 69 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.733642:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367616:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.733653:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1fc:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.733657:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.733661:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.733683:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 69 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.733694:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 69 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.733698:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.733708:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367744:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.733744:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.734777:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367616:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.734808:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.735126:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.735156:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125504
00000100:00100000:3.0:1782361985.735170:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125504
00010000:00010000:3.0:1782361985.735246:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 68 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.735277:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 163
00000100:00100000:3.0:1782361985.735288:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+68:2365:x1868940985125504:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.735299:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.735305:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 68 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.735317:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 68 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.735333:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a6f3299/0x57e58d5a90c7cc87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb292a expref: 68 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.735344:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.735348:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.735352:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.735360:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.735384:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.735413:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.735420:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+67:2365:x1868940985125504:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 131us (292us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.735429:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735450:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.735451:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 163
00010000:00010000:2.0:1782361985.735463:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735493:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.735521:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.735529:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.735545:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.735549:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.735559:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.735573:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.735582:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eb58 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.735600:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.735604:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.735607:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.735629:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735643:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 66 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735650:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f9:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.735653:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.735657:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735678:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 66 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.735689:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 66 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.735700:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367872:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.735744:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.736385:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.736412:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992367744:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.736427:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125632
00010000:00010000:1.0:1782361985.736431:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.736434:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125632
00010000:00010000:2.0:1782361985.736456:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 70 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.736498:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 164
00000100:00100000:2.0:1782361985.736507:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+70:2365:x1868940985125632:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.736516:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.736520:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 70 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736528:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 70 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736539:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fe705eff/0x57e58d5a90c7cd2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2969 expref: 70 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736549:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.736553:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.736558:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736565:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736589:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.736616:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+69:2365:x1868940985125632:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 111us (232us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.736624:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 164
00010000:00010000:1.0:1782361985.736662:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.736671:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.736691:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.736698:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.736715:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.736736:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.736742:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736750:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.736753:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736761:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736773:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736780:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7eb5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.736806:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.736809:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.736811:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.737016:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.737029:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 68 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.737036:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1fb:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.737039:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.737043:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.737077:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 68 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.737087:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 68 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.737098:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368000:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.737150:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.737330:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.737330:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992367872:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.737351:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.737366:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125760
00000100:00100000:0.0:1782361985.737372:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125760
00010000:00010000:0.0:1782361985.737392:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 67 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.737427:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 165
00000100:00100000:0.0:1782361985.737436:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+67:2365:x1868940985125760:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.737445:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.737451:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 67 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.737461:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 67 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.737475:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008713005c/0x57e58d5a90c7cc17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2900 expref: 67 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.737485:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.737489:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.737493:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.737507:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.737534:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.737552:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.737561:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+66:2365:x1868940985125760:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 126us (230us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.737567:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 165
00010000:00010000:2.0:1782361985.737580:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737589:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737596:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737612:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.737698:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737709:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 65 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737716:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f8:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.737719:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.737722:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737739:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 65 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.737747:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 65 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.737763:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368128:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.737809:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.737992:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.737997:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738003:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.738005:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738011:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738019:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738025:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb66 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738038:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.738039:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.738041:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.738177:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368000:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.738191:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.738421:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.738504:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985125888
00000100:00100000:3.0:1782361985.738508:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985125888
00010000:00010000:3.0:1782361985.738522:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 69 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.738561:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 166
00000100:00100000:3.0:1782361985.738570:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504753c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+69:2365:x1868940985125888:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.738579:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.738584:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 69 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738595:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 69 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738661:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b0276496/0x57e58d5a90c7ccbf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb293f expref: 69 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738677:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.738681:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.738686:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738693:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.738713:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.738734:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368128:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.738745:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738749:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.738756:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504753c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+68:2365:x1868940985125888:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 183us (332us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.738762:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.738777:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 166
00010000:00010000:1.0:1782361985.738781:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.738804:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.738825:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.738869:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.738877:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738886:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.738890:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738898:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738911:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738919:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7eb6d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.738937:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.738946:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.738948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.739013:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.739038:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126016
00000100:00100000:2.0:1782361985.739043:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126016
00010000:00010000:2.0:1782361985.739061:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 66 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.739091:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 167
00000100:00100000:2.0:1782361985.739102:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+66:2364:x1868940985126016:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.739111:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.739117:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 66 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739123:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.739129:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 66 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739157:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 67 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.739159:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000029550ffa/0x57e58d5a90c7cba7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28d6 expref: 66 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739178:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1fa:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.739183:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.739190:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.739193:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.739196:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739197:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.739221:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739237:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 67 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739256:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 67 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.739260:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.739273:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368256:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.739284:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739294:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.739296:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+65:2364:x1868940985126016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 195us (280us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.739312:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.739313:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 167
00010000:00010000:0.0:1782361985.739313:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739326:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739347:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.739363:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.739369:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739377:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.739381:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739389:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739402:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739410:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7eb74 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.739445:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.739448:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.739450:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.739457:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739472:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 64 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739490:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f7:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.739494:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.739498:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739518:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 64 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.739527:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 64 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.739537:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368384:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.739573:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e840 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.743042:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368256:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.743075:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.743087:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.743102:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.743104:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368384:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.743127:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.743153:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126144
00000100:00100000:2.0:1782361985.743160:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126144
00010000:00010000:2.0:1782361985.743192:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 68 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.743202:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126272
00000100:00100000:0.0:1782361985.743209:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126272
00000100:00100000:2.0:1782361985.743230:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 168
00010000:00010000:0.0:1782361985.743230:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 65 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.743256:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+68:2365:x1868940985126144:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1782361985.743257:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 169
00000100:00100000:3.0:1782361985.743274:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+65:2363:x1868940985126272:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.743276:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.743285:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 68 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743286:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.743295:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 65 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743301:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 68 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743310:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 65 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743322:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008841d398/0x57e58d5a90c7cc4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2915 expref: 68 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743325:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000075da223e/0x57e58d5a90c7cb37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28ac expref: 65 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743342:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.743348:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.743358:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743363:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.743372:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743376:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1fa:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.743388:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743397:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743410:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.743440:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.743442:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743452:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.743455:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+64:2363:x1868940985126272:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 187us (356us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.743462:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.743463:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 169
00000100:00100000:2.0:1782361985.743469:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+67:2365:x1868940985126144:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 219us (393us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.743487:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 168
00010000:00010000:0.0:1782361985.743492:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743501:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743510:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743510:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.743516:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.743525:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743526:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743539:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743545:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.743552:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743556:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.743564:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743578:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.743581:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743584:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743594:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.743600:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743603:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006d15f189/0x57e58d5a90c7eb82 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743628:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.743630:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.743632:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.743659:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743672:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.743679:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087c33292/0x57e58d5a90c7eb7b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1fa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743693:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743707:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 63 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743714:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f6:0x0].0x0 since=197s v=(0 0)
00010000:00010000:0.0:1782361985.743718:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.743722:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.743727:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.743732:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.743736:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.743754:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 63 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.743764:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 63 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.743775:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368512:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.743879:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.743889:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743903:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 66 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743921:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f9:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.743925:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.743928:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743946:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 66 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.743955:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 66 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.743966:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368640:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.744002:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.744536:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368512:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.744557:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.744923:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.744957:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126400
00000100:00100000:2.0:1782361985.744964:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126400
00010000:00010000:2.0:1782361985.744984:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 64 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.745014:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 170
00000100:00100000:2.0:1782361985.745023:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+64:2365:x1868940985126400:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.745032:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.745038:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 64 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745055:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 64 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745067:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e1f8f28/0x57e58d5a90c7cac7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2882 expref: 64 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745090:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.745094:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.745099:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745107:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.745120:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368640:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.745139:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.745141:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745168:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.745178:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+63:2365:x1868940985126400:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 155us (253us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.745186:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.745192:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 170
00010000:00010000:3.0:1782361985.745227:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745248:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745264:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.745277:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.745284:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745293:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.745297:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745306:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745320:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745339:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7eb89 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745355:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.745357:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.745359:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.745422:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745432:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 62 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745437:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f5:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.745440:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.745444:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745466:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 62 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745476:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 62 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.745540:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368768:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.745596:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.745623:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126528
00000100:00100000:2.0:1782361985.745627:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126528
00010000:00010000:2.0:1782361985.745644:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 67 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.745664:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 171
00000100:00100000:2.0:1782361985.745670:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+67:2364:x1868940985126528:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.745682:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.745687:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 67 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745698:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 67 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745714:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001d4e8847/0x57e58d5a90c7cbdf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28eb expref: 67 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745725:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.745734:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.745738:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745746:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.745775:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.745784:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e509372900 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.745811:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3ca680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+66:2364:x1868940985126528:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 139us (214us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.745819:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 171
00010000:00010000:3.0:1782361985.745870:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745891:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745899:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745906:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.745925:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.745997:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.746002:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.746009:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.746013:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.746026:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.746037:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.746044:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7eb90 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.746059:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.746061:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.746062:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.746225:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.746239:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 65 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.746246:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f8:0x0].0x0 since=197s v=(0 0)
00010000:00010000:2.0:1782361985.746250:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.746254:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.746273:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 65 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.746282:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 65 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.746304:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368896:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.746347:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.747293:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992368768:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.747310:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.747940:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.747988:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126656
00000100:00100000:0.0:1782361985.747995:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126656
00010000:00010000:0.0:1782361985.748023:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 63 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.748026:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992368896:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.748048:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.748065:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 172
00000100:00100000:0.0:1782361985.748086:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+63:2365:x1868940985126656:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.748099:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.748105:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 63 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.748117:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 63 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.748135:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000083f04659/0x57e58d5a90c7ca57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2858 expref: 63 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.748149:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.748152:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.748157:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.748165:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.748196:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.748217:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748229:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.748230:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2365:x1868940985126656:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 144us (291us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.748242:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 172
00010000:00010000:1.0:1782361985.748253:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748262:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748287:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.748305:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.748313:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.748322:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cea00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.748327:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.748334:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.748343:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.748348:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086fa214b/0x57e58d5a90c7eb97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.748362:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.748363:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.748365:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.748422:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748435:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 61 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748442:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f4:0x0].0x0 since=197s v=(0 0)
00010000:00010000:1.0:1782361985.748445:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.748461:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748485:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 61 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.748494:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 61 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.748506:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369024:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.748551:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a780 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.749849:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.749895:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126784
00000100:00100000:1.0:1782361985.749902:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126784
00010000:00010000:1.0:1782361985.749930:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 66 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.749965:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 173
00000100:00100000:1.0:1782361985.749975:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504752850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+66:2365:x1868940985126784:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.749986:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.749992:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 66 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750008:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 66 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.750028:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.750028:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004b0031b4/0x57e58d5a90c7cb6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb28c1 expref: 66 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.750038:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074da680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369024:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.750045:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.750050:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.750056:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.750058:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750075:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.750096:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985126912
00000100:00100000:3.0:1782361985.750100:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985126912
00010000:00010000:3.0:1782361985.750116:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 62 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750124:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361985.750142:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 174
00000100:00100000:3.0:1782361985.750148:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2364:x1868940985126912:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.750156:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1782361985.750157:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504752850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+65:2365:x1868940985126784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 184us (329us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.750162:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 62 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.750165:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 173
00010000:00010000:3.0:1782361985.750176:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 62 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750176:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750197:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.750203:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000009fb4e08/0x57e58d5a90c7c9e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb282e expref: 62 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750209:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750229:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.750246:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.750249:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.750251:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.750258:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.750266:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750322:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.750330:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.750338:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.750347:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.750354:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+61:2364:x1868940985126912:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 205us (329us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.750355:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.750361:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 174
00010000:00010000:3.0:1782361985.750370:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.750381:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1782361985.750389:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750398:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.750402:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750413:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750426:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750445:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7eb9e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750461:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.750466:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750474:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.750478:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750488:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750500:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750504:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750514:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7eba5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750521:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 60 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750530:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.750532:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.750535:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.750539:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.750543:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.750548:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750572:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 60 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750578:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.750585:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 60 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750606:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 64 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750616:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f7:0x0].0x0 since=197s v=(0 0)
00000100:00100000:1.0:1782361985.750618:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369152:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.750622:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.750628:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750651:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 64 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.750662:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 64 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.750673:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369280:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.750675:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.750701:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.750881:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.752219:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369152:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.752244:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8e00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369280:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.752249:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752264:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.752457:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.752491:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.752519:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127040
00000100:00100000:0.0:1782361985.752526:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127040
00010000:00010000:0.0:1782361985.752556:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 61 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.752582:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127168
00000100:00100000:0.0:1782361985.752585:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127168
00010000:00010000:0.0:1782361985.752595:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 65 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.752602:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 175
00000100:00100000:2.0:1782361985.752611:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+61:2362:x1868940985127040:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.752624:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 176
00000100:00100000:0.0:1782361985.752631:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+65:2362:x1868940985127168:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.752635:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.752638:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.752645:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 65 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752646:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 61 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752668:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 61 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752674:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 65 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752692:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002a342029/0x57e58d5a90c7c977 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2804 expref: 61 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752698:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000068c2fd32/0x57e58d5a90c7caff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2897 expref: 65 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752704:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.752708:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.752711:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.752712:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752722:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.752723:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752731:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752741:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752746:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.752768:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.752775:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.752779:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:2362:x1868940985127040:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (323us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.752804:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+64:2362:x1868940985127168:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 172us (316us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.752809:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.752811:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 175
00000100:00100000:0.0:1782361985.752821:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 176
00010000:00010000:3.0:1782361985.752863:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.752873:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.752888:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.752895:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.752904:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.752913:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.752916:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.752929:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.752935:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:2.0:1782361985.752939:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.752942:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752946:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.752958:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.752964:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.752983:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.752987:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.753012:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.753013:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.753040:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.753042:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.753060:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7ebac lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.753063:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ebb3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.753088:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.753089:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.753092:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.753093:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.753098:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.753099:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.753104:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.753107:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 59 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.753121:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.753134:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.753139:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.753142:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 63 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.753146:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.753156:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f6:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.753164:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.753169:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.753184:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 59 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.753199:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 59 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.753210:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 63 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.753213:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369408:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.753229:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 63 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.753241:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369536:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.753272:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.753273:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.756727:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369408:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.756729:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.756757:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.756798:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.756802:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127296
00000100:00100000:0.0:1782361985.756810:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127296
00000100:00100000:1.0:1782361985.756825:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127424
00000100:00100000:1.0:1782361985.756855:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127424
00010000:00010000:1.0:1782361985.756884:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 64 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.756921:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369536:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.756923:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 177
00000100:00100000:1.0:1782361985.756937:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+64:2363:x1868940985127424:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.756943:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.756971:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.756979:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 64 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.756991:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 60 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.756994:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 64 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757029:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aa3b49c0/0x57e58d5a90c7ca8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb286d expref: 64 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.757040:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 178
00010000:00010000:1.0:1782361985.757045:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.757052:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f6:0x0].0x0 since=0s v=(1 0)
00000100:00100000:0.0:1782361985.757052:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:2365:x1868940985127296:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.757062:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757066:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.757075:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 60 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757079:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757097:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 60 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757115:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.757128:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000093887664/0x57e58d5a90c7c907 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27da expref: 60 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757142:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.757144:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757146:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.757157:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.757164:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.757169:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+63:2363:x1868940985127424:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 232us (381us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.757175:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.757189:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 177
00010000:00010000:2.0:1782361985.757190:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.757203:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757211:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.757223:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.757223:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757236:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.757237:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+59:2365:x1868940985127296:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 188us (516us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.757239:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.757248:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.757255:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 178
00010000:00010000:2.0:1782361985.757267:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfe00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.757267:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.757274:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757285:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757303:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.757322:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.757327:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757333:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.757336:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757343:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757364:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757370:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5d74a56/0x57e58d5a90c7ebba lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757387:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.757392:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.757393:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.757394:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.757459:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.757480:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000045fe3f27/0x57e58d5a90c7ebc1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.757499:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.757502:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.757504:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.757505:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757507:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757528:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 58 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757536:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f1:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.757539:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.757543:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757570:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 58 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.757583:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 58 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.757593:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369664:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.757642:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.758718:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 62 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.758726:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f5:0x0].0x0 since=197s v=(0 0)
00010000:00010000:3.0:1782361985.758730:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.758734:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.758759:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 62 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.758770:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 62 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.758777:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369664:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.758802:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369792:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.758806:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.758864:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ec00 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.759508:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.759543:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127552
00000100:00100000:2.0:1782361985.759550:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127552
00010000:00010000:2.0:1782361985.759576:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 59 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.759614:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 179
00000100:00100000:2.0:1782361985.759624:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+59:2364:x1868940985127552:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.759635:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.759641:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 59 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.759652:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 59 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.759668:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009517a09b/0x57e58d5a90c7c897 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27b0 expref: 59 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.759678:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.759682:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.759694:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.759702:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.759727:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.759750:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.759759:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.759765:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.759769:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.759793:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.759816:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.759824:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.759858:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.759863:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.759873:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.759886:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.759895:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071fd7544/0x57e58d5a90c7ebcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.759921:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.759924:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.759928:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.760333:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.760343:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.760347:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1f0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.760349:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.760357:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.760384:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.760395:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.760408:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369920:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.760427:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992369792:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.760444:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.763012:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:2364:x1868940985127552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 3379us (3494us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.763025:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 179
00000100:00100000:0.0:1782361985.763033:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.763087:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127680
00000100:00100000:2.0:1782361985.763095:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127680
00010000:00010000:2.0:1782361985.763134:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 63 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.763174:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 180
00000100:00100000:2.0:1782361985.763183:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504752450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+63:2365:x1868940985127680:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.763194:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.763201:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 63 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.763213:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 63 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.763234:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f57363a0/0x57e58d5a90c7ca1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2843 expref: 63 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.763264:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.763268:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.763273:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.763280:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.763310:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.763310:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.763341:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763353:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.763354:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504752450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2365:x1868940985127680:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 171us (325us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.763364:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 180
00010000:00010000:3.0:1782361985.763377:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763385:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763407:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.763599:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763608:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 61 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763613:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f4:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.763616:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.763618:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763636:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 61 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.763644:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 61 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.763652:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370048:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.763695:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ecc0 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.763823:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.763852:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.763863:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.763868:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.763877:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.763890:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.763898:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a67e991d/0x57e58d5a90c7ebc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.763921:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.763923:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.763925:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.765753:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992369920:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.765779:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.765797:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.765810:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370048:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.765860:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.765894:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.765911:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127808
00000100:00100000:1.0:1782361985.765918:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127808
00010000:00010000:1.0:1782361985.765947:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.765955:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985127936
00000100:00100000:2.0:1782361985.765961:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985127936
00010000:00010000:2.0:1782361985.765982:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 62 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.765982:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 181
00000100:00100000:1.0:1782361985.765996:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:2364:x1868940985127808:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.766012:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.766018:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766030:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766047:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8b88fa3/0x57e58d5a90c7c827 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2786 expref: 58 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.766052:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 182
00000100:00100000:2.0:1782361985.766062:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2365:x1868940985127936:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.766077:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.766080:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.766086:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.766090:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766092:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 62 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766110:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766116:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 62 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766137:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.766147:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3c7a13c/0x57e58d5a90c7c9af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2819 expref: 62 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766162:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.766165:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.766168:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.766170:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:2364:x1868940985127808:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 177us (387us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.766182:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.766186:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 181
00010000:00010000:3.0:1782361985.766191:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.766203:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766205:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.766216:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.766225:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.766232:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+61:2365:x1868940985127936:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 170us (373us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.766240:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 182
00010000:00010000:3.0:1782361985.766247:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.766280:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.766286:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766292:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.766295:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766301:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766311:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766316:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002fd76080/0x57e58d5a90c7ebd6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766336:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.766338:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.766339:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.766388:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766399:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766407:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766415:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766432:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766437:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.766450:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 56 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766454:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.766462:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766462:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ef:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.766469:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.766477:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766478:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.766485:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766494:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766517:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 56 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766522:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.766533:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000016179d03/0x57e58d5a90c7ebdd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.766537:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 56 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.766557:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370176:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.766558:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.766563:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.766566:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.766570:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766584:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 60 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766592:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.766595:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.766599:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.766617:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 60 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.766623:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.766626:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 60 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.766649:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370304:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.766683:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.768275:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.768306:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370304:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.768312:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128064
00000100:00100000:2.0:1782361985.768318:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128064
00010000:00010000:1.0:1782361985.768335:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768343:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 57 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.768381:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 183
00000100:00100000:2.0:1782361985.768389:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:2364:x1868940985128064:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.768400:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.768406:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 57 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768418:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 57 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768435:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.768439:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.768453:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768462:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768478:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.768516:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:2364:x1868940985128064:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 126us (246us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.768524:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 183
00000100:00100000:3.0:1782361985.768583:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.768583:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009949ba42/0x57e58d5a90c7c7b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb275c expref: 56 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.768600:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370176:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.768622:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768649:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768654:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768660:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768664:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768679:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.768681:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128192
00000100:00100000:2.0:1782361985.768686:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128192
00010000:00010000:2.0:1782361985.768704:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 61 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.768731:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 184
00000100:00100000:2.0:1782361985.768740:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+61:2364:x1868940985128192:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.768750:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.768752:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.768757:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 61 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768761:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768776:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.768778:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 61 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768780:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768804:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e7e40e25/0x57e58d5a90c7c93f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27ef expref: 61 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768809:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768813:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768865:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768870:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.768870:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 55 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768879:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.768884:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037122b0a/0x57e58d5a90c7ebe4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768891:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.768893:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ee:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.768902:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.768912:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768913:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.768950:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.768950:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.768955:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.768956:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 55 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.768959:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.768959:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.768980:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.768985:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:2364:x1868940985128192:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 243us (400us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.768985:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 55 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.769001:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.769004:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 184
00000100:00100000:0.0:1782361985.769012:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370432:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.769017:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.769060:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e840 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.769065:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.769077:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.769084:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.769105:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.769109:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.769116:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.769129:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.769137:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ebeb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.769191:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.769206:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 59 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.769214:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.769217:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.769222:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.769235:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.769239:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.769243:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.769244:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 59 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.769255:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 59 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.769266:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370560:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.769301:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.770268:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370432:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.770287:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.774639:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.774707:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.774745:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128320
00000100:00100000:1.0:1782361985.774751:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370560:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.774753:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128320
00000100:00100000:0.0:1782361985.774773:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128448
00000100:00100000:0.0:1782361985.774779:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128448
00010000:00010000:1.0:1782361985.774780:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.774784:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 56 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.774820:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 60 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.774867:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 185
00000100:00100000:3.0:1782361985.774879:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+56:2364:x1868940985128320:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.774886:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 186
00010000:00010000:3.0:1782361985.774897:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:0.0:1782361985.774898:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:2365:x1868940985128448:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.774907:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 56 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.774910:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.774919:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 60 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.774939:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 60 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.774946:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 56 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.774980:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d6ff1ba7/0x57e58d5a90c7c747 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2732 expref: 56 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.774982:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000056f0a412/0x57e58d5a90c7c8cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb27c5 expref: 60 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.774999:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.775000:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.775008:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.775009:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.775014:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.775015:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.775036:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775036:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.775062:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.775066:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.775088:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775111:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.775122:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:2364:x1868940985128320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 242us (488us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.775124:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+59:2365:x1868940985128448:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 225us (412us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.775125:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.775142:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 185
00010000:00010000:1.0:1782361985.775145:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.775150:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 186
00010000:00010000:1.0:1782361985.775174:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.775181:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.775187:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775196:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.775200:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775209:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775235:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775243:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ebf9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775261:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.775264:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.775266:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.775290:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775299:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775305:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775310:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775342:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775356:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 58 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775364:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f1:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.775367:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.775371:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775395:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 58 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.775408:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 58 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.775425:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370688:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.775489:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a000 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.775662:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.775664:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.775672:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.775681:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.775684:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.775693:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.775719:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.775726:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ebf2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.775742:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.775745:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.775747:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.775784:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775811:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 54 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775822:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ed:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.775825:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.775904:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775926:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 54 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.775935:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 54 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.775946:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370816:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.775984:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.777455:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370816:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.777477:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.777528:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992370688:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.777548:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.777550:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.777581:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128704
00000100:00100000:2.0:1782361985.777587:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128704
00010000:00010000:2.0:1782361985.777608:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 55 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.777672:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 187
00000100:00100000:1.0:1782361985.777684:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504752c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:2362:x1868940985128704:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.777698:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.777704:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 55 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.777714:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 55 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.777730:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000037e20075/0x57e58d5a90c7c6d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2708 expref: 55 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.777742:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.777745:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.777750:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.777772:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.777812:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.777876:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504752c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:2362:x1868940985128704:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 193us (326us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.777884:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 187
00010000:00010000:0.0:1782361985.777992:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778011:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778021:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778034:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778053:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.778177:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778189:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 53 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778196:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ec:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.778199:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.778202:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778224:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 53 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.778247:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 53 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.778258:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370944:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.778308:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e840 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.778346:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.778352:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778360:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.778364:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778372:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778383:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778390:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ec07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778406:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.778414:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.778416:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.778572:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.778700:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128576
00000100:00100000:1.0:1782361985.778706:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128576
00010000:00010000:1.0:1782361985.778726:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 59 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.778756:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 188
00000100:00100000:1.0:1782361985.778766:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+59:2364:x1868940985128576:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.778774:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.778780:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 59 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778804:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 59 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778819:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000da2212ca/0x57e58d5a90c7c85f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb279b expref: 59 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778865:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.778868:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.778872:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778881:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.778911:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.778923:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.778936:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:2364:x1868940985128576:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 172us (363us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.778937:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.778948:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 188
00010000:00010000:3.0:1782361985.778970:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.778976:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.778997:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.779100:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.779104:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.779109:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.779111:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.779117:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.779124:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.779127:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec00 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.779137:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.779139:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.779140:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.779451:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.779460:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 57 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.779465:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1f0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.779467:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.779469:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.779483:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 57 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.779609:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 57 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.779616:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371072:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.779659:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71ecc0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.780026:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.780171:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128832
00000100:00100000:2.0:1782361985.780176:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128832
00010000:00010000:2.0:1782361985.780199:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 54 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.780217:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992370944:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.780241:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 189
00000100:00100000:2.0:1782361985.780252:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:2364:x1868940985128832:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.780262:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.780262:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780271:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 54 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780296:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 54 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780311:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e11d77d/0x57e58d5a90c7c667 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26de expref: 54 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780321:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.780325:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.780329:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780337:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.780364:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.780392:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+53:2364:x1868940985128832:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 143us (367us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.780398:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 189
00010000:00010000:0.0:1782361985.780404:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780414:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780423:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780431:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780456:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.780581:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780594:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 52 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780601:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1eb:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.780604:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.780608:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780640:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 52 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.780649:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 52 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.780660:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371200:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.780703:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.780746:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.780757:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.780765:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.780769:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.780778:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.780800:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.780808:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec0e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.780822:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.780824:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.780847:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.781655:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fc700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371072:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.781670:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.781722:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371200:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.781735:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.781933:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.781954:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.782038:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985128960
00000100:00100000:1.0:1782361985.782043:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985128960
00010000:00010000:1.0:1782361985.782063:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 58 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.782100:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129088
00000100:00100000:1.0:1782361985.782104:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129088
00010000:00010000:1.0:1782361985.782118:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 53 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.782120:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 190
00000100:00100000:2.0:1782361985.782133:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:2364:x1868940985128960:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.782141:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1782361985.782143:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 191
00000100:00100000:1.0:1782361985.782153:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+53:2362:x1868940985129088:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.782158:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 58 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782162:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.782169:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 53 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782177:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 53 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782200:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007fae47c4/0x57e58d5a90c7c5f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26b4 expref: 53 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782204:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 58 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782215:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.782219:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.782222:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782223:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dd8f8aa7/0x57e58d5a90c7c7ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2771 expref: 58 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782251:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782254:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.782262:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.782265:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782284:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782301:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.782303:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.782315:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782326:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782335:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782343:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782359:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:1.0:1782361985.782389:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:2362:x1868940985129088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 189us (385us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.782398:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 191
00000100:00100000:2.0:1782361985.782402:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:2364:x1868940985128960:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 271us (468us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.782409:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 190
00010000:00010000:2.0:1782361985.782429:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.782434:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782440:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.782441:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782443:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782462:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782474:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782476:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782479:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782494:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782495:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782509:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d429cd07/0x57e58d5a90c7ec15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782523:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.782523:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.782528:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782533:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.782535:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782536:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.782540:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782547:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782551:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ccf82bdb/0x57e58d5a90c7ec1c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782569:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.782571:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.782572:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.782609:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 56 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.782617:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ef:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.782620:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.782624:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782634:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782663:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 51 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782671:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ea:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.782681:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.782686:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782698:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 56 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.782712:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 56 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.782714:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 51 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.782728:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371328:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.782736:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 51 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.782750:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371456:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.782757:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.782784:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.784362:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371328:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.784378:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.784385:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371456:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.784402:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.785130:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.785152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.785206:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129216
00000100:00100000:2.0:1782361985.785213:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129216
00010000:00010000:2.0:1782361985.785248:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 57 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.785277:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129344
00000100:00100000:2.0:1782361985.785281:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129344
00010000:00010000:2.0:1782361985.785295:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 52 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.785297:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 192
00000100:00100000:3.0:1782361985.785310:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:2365:x1868940985129216:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.785319:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.785327:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 57 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785337:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 57 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785351:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000075f889a3/0x57e58d5a90c7c77f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2747 expref: 57 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.785356:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 193
00010000:00010000:3.0:1782361985.785367:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.785372:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ef:0x0].0x0 since=0s v=(1 0)
00000100:00100000:2.0:1782361985.785372:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:2365:x1868940985129344:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.785378:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785386:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785386:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.785396:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 52 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785408:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.785409:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 52 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785426:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cd2fc3b8/0x57e58d5a90c7c587 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb268a expref: 52 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.785436:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+56:2365:x1868940985129216:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (306us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.785438:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.785443:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.785450:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.785454:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 192
00010000:00010000:2.0:1782361985.785465:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785485:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.785500:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785509:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.785510:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:2365:x1868940985129344:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 140us (352us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.785527:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.785528:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 193
00010000:00010000:3.0:1782361985.785538:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.785550:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.785727:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785740:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 55 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785747:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ee:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.785749:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.785753:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785777:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 55 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.785799:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 55 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.785812:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371584:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.785891:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.786104:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.786111:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786120:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.786124:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786133:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786158:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786166:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ec23 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ef:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786180:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.786182:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.786184:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.786198:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786206:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786215:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786222:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786251:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.786349:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786362:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 50 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786378:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e9:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.786381:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.786385:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786405:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 50 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.786414:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 50 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.786424:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371712:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.786456:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.786575:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.786581:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.786588:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.786592:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.786609:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.786621:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.786628:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f5295343/0x57e58d5a90c7ec2a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.786692:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.786693:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.786695:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.790200:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.790227:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371584:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.790238:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.790262:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129472
00000100:00100000:3.0:1782361985.790266:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129472
00000100:00100000:0.0:1782361985.790271:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129600
00000100:00100000:0.0:1782361985.790278:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129600
00010000:00010000:3.0:1782361985.790293:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 56 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790303:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 51 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.790327:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 194
00000100:00100000:0.0:1782361985.790336:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 195
00000100:00100000:3.0:1782361985.790337:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504753050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+56:2364:x1868940985129472:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.790351:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.790352:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.790352:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:2365:x1868940985129600:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.790357:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 56 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790370:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.790380:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 51 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.790382:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 56 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790401:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 51 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790428:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.790440:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b2f6565a/0x57e58d5a90c7c517 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2660 expref: 51 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790442:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.790454:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.790461:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371712:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.790472:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790484:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790492:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.790537:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+50:2365:x1868940985129600:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 188us (296us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.790545:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 195
00010000:00010000:1.0:1782361985.790649:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790654:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790665:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790670:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790685:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.790721:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.790727:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790735:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.790740:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790749:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790762:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790783:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec38 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.790812:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.790813:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.790815:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.790868:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bac990be/0x57e58d5a90c7c70f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb271d expref: 56 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790870:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.790882:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.790882:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 49 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.790886:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ee:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.790889:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e8:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.790890:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790892:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.790897:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.790898:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.790920:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.790921:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 49 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.790933:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 49 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.790946:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371840:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.791060:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791067:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791073:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791085:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791094:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.791102:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.791104:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791108:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.791111:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791116:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791123:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791127:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd00a568/0x57e58d5a90c7ec31 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ee:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791136:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.791137:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.791138:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.791206:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791219:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791224:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ed:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.791226:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.791228:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791350:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.791359:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.791369:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371968:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.791876:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504753050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:2364:x1868940985129472:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1539us (1682us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.791885:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 194
00000100:00100000:2.0:1782361985.791942:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.791971:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.792907:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992371840:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.792926:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.793027:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992371968:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.793039:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.793253:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.793297:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.793310:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129728
00000100:00100000:3.0:1782361985.793317:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129728
00000100:00100000:2.0:1782361985.793336:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129856
00010000:00010000:3.0:1782361985.793339:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.793342:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129856
00010000:00010000:2.0:1782361985.793366:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 50 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.793372:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 196
00000100:00100000:3.0:1782361985.793382:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:2363:x1868940985129728:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.793403:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.793408:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.793427:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 197
00000100:00100000:2.0:1782361985.793435:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+50:2364:x1868940985129856:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.793444:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.793449:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 50 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793459:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 50 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793477:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cf4e9bc1/0x57e58d5a90c7c4a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2636 expref: 50 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793488:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.793492:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.793496:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793505:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793529:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.793552:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793563:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793572:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793580:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793601:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793602:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.793614:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:2364:x1868940985129856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 177us (315us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.793621:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000074a6dd2/0x57e58d5a90c7c69f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26f3 expref: 55 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.793628:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 197
00010000:00010000:3.0:1782361985.793633:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.793639:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ed:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.793643:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793649:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793664:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.793672:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.793684:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:2363:x1868940985129728:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 303us (432us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.793685:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.793694:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 196
00010000:00010000:2.0:1782361985.793708:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793717:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793737:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.793812:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793846:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1782361985.793848:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 48 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793854:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793874:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e7:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.793880:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.793881:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.793883:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793888:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793907:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 48 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793910:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793911:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.793921:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 48 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793941:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793945:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 53 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.793946:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372096:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.793959:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009f8d2af8/0x57e58d5a90c7ec3f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.793966:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ec:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.793972:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.793977:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793984:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:0.0:1782361985.793987:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e840 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.793988:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.793995:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.793998:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.794002:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 53 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.794005:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.794008:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.794024:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.794037:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ec46 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ed:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.794038:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 53 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.794058:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.794061:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372224:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.794062:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.794064:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.794091:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.795458:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372096:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.795479:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.795591:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372224:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.795604:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.795781:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.796033:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985129984
00000100:00100000:3.0:1782361985.796039:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985129984
00010000:00010000:3.0:1782361985.796066:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 54 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.796073:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.796121:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130112
00000100:00100000:3.0:1782361985.796126:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130112
00000100:00100000:0.0:1782361985.796142:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 198
00010000:00010000:3.0:1782361985.796145:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 49 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.796219:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:2362:x1868940985129984:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:2.0:1782361985.796223:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 199
00000100:00100000:2.0:1782361985.796238:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:2365:x1868940985130112:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.796249:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.796255:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 49 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796264:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 49 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796277:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e528a8b/0x57e58d5a90c7c437 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb260c expref: 49 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.796299:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.796302:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.796308:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.796309:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 54 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796327:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.796336:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 54 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796340:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.796357:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001388edb3/0x57e58d5a90c7c62f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb26c9 expref: 54 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.796370:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.796372:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.796374:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ec:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.796380:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.796389:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.796409:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:2365:x1868940985130112:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 176us (341us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.796412:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.796417:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 199
00000100:00100000:0.0:1782361985.796439:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+53:2362:x1868940985129984:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 225us (656us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.796446:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.796451:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 198
00010000:00010000:2.0:1782361985.796458:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796464:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796469:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796481:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.796492:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.796496:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796509:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.796511:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796517:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796518:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796540:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796544:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796556:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796557:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec54 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ec:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796580:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796584:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.796587:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.796588:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.796599:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.796748:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796762:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 47 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796770:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e6:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.796779:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.796784:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796820:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796824:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 47 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796867:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 52 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.796874:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 47 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796880:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1eb:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.796889:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.796893:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.796896:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372352:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.796922:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 52 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.796929:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 52 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.796937:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372480:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.796958:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.796964:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.797022:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.797028:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.797036:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.797039:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.797058:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.797069:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.797076:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec4d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.797093:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.797095:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.797097:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.798261:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074db100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372352:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.798292:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.798369:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372480:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.798386:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.798435:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.798584:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130240
00000100:00100000:0.0:1782361985.798589:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130240
00010000:00010000:0.0:1782361985.798620:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 48 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.798659:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 200
00000100:00100000:0.0:1782361985.798669:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:2365:x1868940985130240:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.798679:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.798691:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 48 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798703:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 48 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798719:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca4c0733/0x57e58d5a90c7c3c7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25e2 expref: 48 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798731:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.798734:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.798737:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798743:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798759:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.798825:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+47:2365:x1868940985130240:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 121us (355us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.798851:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 200
00000100:00100000:2.0:1782361985.798867:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.798880:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130368
00000100:00100000:0.0:1782361985.798885:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130368
00010000:00010000:1.0:1782361985.798893:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798900:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 53 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.798903:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.798912:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.798920:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.798920:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 201
00000100:00100000:0.0:1782361985.798929:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+53:2365:x1868940985130368:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.798936:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.798945:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.798951:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 53 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798962:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 53 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.798970:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.798977:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.798978:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000244fb1b0/0x57e58d5a90c7c5bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb269f expref: 53 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.798998:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.799001:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.799004:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.799006:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1eb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.799015:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799021:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.799025:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.799051:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.799055:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.799057:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799062:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799065:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ec5b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.799078:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504751450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:2365:x1868940985130368:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 149us (211us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.799088:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.799093:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 46 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.799095:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 201
00010000:00010000:2.0:1782361985.799098:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.799101:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.799106:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.799112:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e5:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.799114:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.799117:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.799125:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799144:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.799152:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 46 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.799166:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 46 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.799178:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372608:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.799194:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.799206:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.799213:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799222:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.799226:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.799236:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.799281:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799291:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 51 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799298:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ea:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.799302:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.799311:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799313:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799336:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799342:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 51 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.799348:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000171cf10c/0x57e58d5a90c7ec62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1eb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.799359:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 51 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.799384:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372736:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.799418:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.799453:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.799456:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.799458:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.800573:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372608:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.800583:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372736:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.800600:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.800610:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.800931:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.800965:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.800993:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130496
00000100:00100000:2.0:1782361985.801000:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130496
00000100:00100000:1.0:1782361985.801022:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130624
00000100:00100000:1.0:1782361985.801027:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130624
00010000:00010000:2.0:1782361985.801028:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 47 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.801078:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 202
00000100:00100000:2.0:1782361985.801089:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+47:2365:x1868940985130496:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.801101:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.801107:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 47 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.801119:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 47 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.801129:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 52 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.801137:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003f821fc9/0x57e58d5a90c7c357 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25b8 expref: 47 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.801150:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.801154:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.801158:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.801165:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 203
00000100:00100000:1.0:1782361985.801177:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:2365:x1868940985130624:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.801182:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.801188:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.801194:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 52 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.801213:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 52 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.801230:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000046e114b5/0x57e58d5a90c7c54f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2675 expref: 52 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.801233:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.801244:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.801248:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ea:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.801252:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.801261:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.801271:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:2365:x1868940985130496:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 183us (339us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.801280:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 202
00010000:00010000:0.0:1782361985.801317:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801339:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801347:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801354:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801372:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.801399:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.801404:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.801413:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.801418:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.801427:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.801441:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.801450:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42e865a/0x57e58d5a90c7ec69 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.801469:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.801471:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.801474:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.801501:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801513:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 45 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801519:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e4:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.801521:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.801524:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801545:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 45 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.801556:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 45 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.801573:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372864:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.801641:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.802277:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.802303:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802313:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802322:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802327:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802338:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.802345:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.802348:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802353:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.802355:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802360:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802373:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802377:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002962b599/0x57e58d5a90c7ec70 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ea:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802387:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.802388:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.802389:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.802490:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802499:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802503:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e9:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.802505:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.802508:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802520:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.802526:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.802540:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372992:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.802571:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:2365:x1868940985130624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 1398us (1605us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.802583:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 203
00000100:00100000:0.0:1782361985.802646:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe3c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.803772:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992372864:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.803816:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.804264:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.804312:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130752
00000100:00100000:0.0:1782361985.804316:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992372992:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.804320:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130752
00010000:00010000:0.0:1782361985.804344:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804352:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 46 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.804353:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.804400:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985130880
00000100:00100000:2.0:1782361985.804407:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 204
00000100:00100000:1.0:1782361985.804412:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985130880
00000100:00100000:2.0:1782361985.804423:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:2365:x1868940985130752:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.804431:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.804459:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 205
00000100:00100000:1.0:1782361985.804468:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:2363:x1868940985130880:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.804479:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.804485:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804495:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804507:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.804514:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001561359e/0x57e58d5a90c7c4df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb264b expref: 51 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804517:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 46 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804540:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 46 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804544:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.804552:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.804558:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804566:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002d736b0c/0x57e58d5a90c7c2e7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb258e expref: 46 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804570:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804590:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.804595:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.804600:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804607:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.804633:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804636:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.804655:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+50:2363:x1868940985130880:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 185us (304us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.804658:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.804673:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 205
00010000:00010000:0.0:1782361985.804675:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804676:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.804687:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.804702:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.804709:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.804717:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.804718:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:2365:x1868940985130752:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 297us (452us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.804736:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 204
00010000:00010000:1.0:1782361985.804737:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.804744:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804754:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804762:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804768:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.804779:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.804808:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000037910d77/0x57e58d5a90c7ec7e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805030:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.805035:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805035:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.805037:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.805047:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.805059:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.805088:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 49 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.805107:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e8:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.805111:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.805115:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.805148:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 49 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.805161:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 49 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.805185:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373120:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.805199:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.805221:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.805228:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805236:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.805240:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805249:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.805258:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fed80 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.805262:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805270:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d8b5cbe/0x57e58d5a90c7ec77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.805285:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.805287:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.805296:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.805351:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.805365:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 44 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.805384:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.805388:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.805392:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.805413:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 44 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.805423:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 44 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.805435:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373248:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.805478:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d43c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.806709:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373248:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.806728:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.806749:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373120:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.806770:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.807228:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.807821:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131136
00000100:00100000:1.0:1782361985.807860:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131136
00010000:00010000:1.0:1782361985.807888:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 50 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.807912:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 206
00000100:00100000:1.0:1782361985.807920:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+50:2363:x1868940985131136:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.807933:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.807939:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 50 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.807950:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 50 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.807966:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d2f29cf3/0x57e58d5a90c7c46f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2621 expref: 50 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.807988:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.807991:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.807995:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808018:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808041:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.808089:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:2363:x1868940985131136:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 169us (861us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.808097:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 206
00010000:00010000:2.0:1782361985.808232:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808241:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808254:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808261:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808290:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.808321:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.808328:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808338:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.808343:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808352:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808366:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808374:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ec85 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808411:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.808417:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808426:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.808429:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.808433:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 48 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808441:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e7:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.808445:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.808449:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808471:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 48 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.808478:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 48 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.808487:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373376:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.808526:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.808706:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.808760:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131008
00000100:00100000:0.0:1782361985.808765:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131008
00010000:00010000:0.0:1782361985.808784:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 45 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.808816:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 207
00000100:00100000:0.0:1782361985.808824:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:2364:x1868940985131008:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.808873:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.808878:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 45 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.808891:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 45 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.808906:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c27c7f5b/0x57e58d5a90c7c277 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2564 expref: 45 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.808916:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.808920:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.808924:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.808932:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.808950:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.808969:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808978:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.808979:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+44:2364:x1868940985131008:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 156us (273us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.808986:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 207
00010000:00010000:1.0:1782361985.808987:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.808994:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.809012:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.809039:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.809046:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809061:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.809065:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809074:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809089:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809096:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ec8c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809115:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.809123:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.809136:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 43 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.809144:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.809147:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.809151:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.809152:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.809156:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.809175:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 43 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.809192:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 43 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.809203:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373504:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.809245:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.809736:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373376:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.809751:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.810283:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.810306:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131264
00000100:00100000:3.0:1782361985.810312:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131264
00010000:00010000:3.0:1782361985.810328:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 49 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.810356:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 208
00000100:00100000:3.0:1782361985.810362:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504750c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:2365:x1868940985131264:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.810388:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373504:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.810404:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810500:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.810507:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 49 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810529:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 49 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.810538:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.810555:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003f356f92/0x57e58d5a90c7c3ff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25f7 expref: 49 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810576:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.810580:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.810584:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.810587:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131392
00000100:00100000:0.0:1782361985.810594:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131392
00010000:00010000:3.0:1782361985.810597:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.810614:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 44 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810622:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.810640:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810649:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.810658:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504750c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:2365:x1868940985131264:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 292us (372us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.810659:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.810666:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 209
00010000:00010000:2.0:1782361985.810675:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.810680:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 208
00000100:00100000:0.0:1782361985.810686:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+44:2365:x1868940985131392:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.810698:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.810699:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.810706:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 44 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.810722:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 44 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.810740:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000098b75eb1/0x57e58d5a90c7c207 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb253a expref: 44 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.810741:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.810751:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.810757:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.810765:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.810767:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.810772:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.810774:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.810812:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.810814:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810821:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810863:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 47 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810876:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e6:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.810877:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.810879:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810882:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.810890:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.810893:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.810897:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ec93 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810915:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810927:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.810928:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:2365:x1868940985131392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 247us (392us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.810930:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.810934:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.810939:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.810954:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.810974:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.810983:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 47 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.810992:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.810998:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 47 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811000:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811010:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.811014:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811023:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811035:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811042:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000d6b4c3d/0x57e58d5a90c7ec9a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.811055:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.811056:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.811058:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.811107:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.811121:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 43 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.811137:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e1:0x0].0x0 since=198s v=(0 0)
00000100:00100000:2.0:1782361985.811141:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373632:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.811142:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.811151:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.811152:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 209
00010000:00010000:3.0:1782361985.811176:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 42 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.811187:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 42 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.811191:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4300 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.811204:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373760:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.811272:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5420d4480 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.812129:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992373632:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.812147:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.812150:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373760:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.812173:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.812473:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.812496:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.812516:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131520
00000100:00100000:0.0:1782361985.812522:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131520
00000100:00100000:2.0:1782361985.812537:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131648
00000100:00100000:2.0:1782361985.812543:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131648
00010000:00010000:0.0:1782361985.812544:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 48 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812563:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 43 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.812576:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 210
00000100:00100000:0.0:1782361985.812586:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:2365:x1868940985131520:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.812598:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1782361985.812599:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 211
00010000:00010000:0.0:1782361985.812608:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 48 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.812619:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:2364:x1868940985131648:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.812625:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 48 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.812630:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.812638:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 43 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.812647:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a720d513/0x57e58d5a90c7c38f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25cd expref: 48 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.812654:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 43 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.812666:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.812671:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.812674:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f08f369e/0x57e58d5a90c7c197 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2510 expref: 43 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.812677:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.812689:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.812693:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.812698:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.812718:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.812722:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.812743:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.812754:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.812771:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812771:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.812777:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2364:x1868940985131648:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 160us (277us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.812798:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+47:2365:x1868940985131520:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 198us (309us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.812800:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.812808:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 211
00010000:00010000:2.0:1782361985.812819:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.812821:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 210
00010000:00010000:2.0:1782361985.812854:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812869:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.812879:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.812884:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812891:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.812905:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812912:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812923:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812928:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d429cd07/0x57e58d5a90c7eca8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.812945:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.812947:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.812951:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.812977:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.812987:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.812995:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.813046:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.813063:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.813077:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 41 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.813082:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1e0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.813085:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.813087:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813091:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.813096:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813103:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.813105:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 41 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813108:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813122:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.813123:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 41 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.813147:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373888:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.813151:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813161:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7eca1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.813185:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.813193:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.813195:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4300 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.813197:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.813202:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.813202:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 46 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.813212:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e5:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.813216:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.813220:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.813242:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 46 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.813252:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 46 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.813276:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374016:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.813305:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe300 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.814126:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992373888:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.814145:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.814223:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.814229:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374016:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.814248:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.814251:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131776
00000100:00100000:3.0:1782361985.814258:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131776
00010000:00010000:3.0:1782361985.814281:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 42 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.814304:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 212
00000100:00100000:3.0:1782361985.814350:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2365:x1868940985131776:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.814357:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.814361:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 42 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814369:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 42 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814380:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038854678/0x57e58d5a90c7c127 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24e6 expref: 42 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814387:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.814390:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.814392:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814407:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.814419:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:3.0:1782361985.814424:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.814458:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814469:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814478:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814487:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.814496:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:2365:x1868940985131776:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 182us (273us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.814504:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:3.0:1782361985.814508:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 212
00000100:00100000:0.0:1782361985.814512:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985131904
00010000:00010000:1.0:1782361985.814516:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:0.0:1782361985.814517:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985131904
00010000:00010000:1.0:1782361985.814525:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.814536:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 47 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814556:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.814560:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814575:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.814575:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 213
00000100:00100000:0.0:1782361985.814589:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+47:2365:x1868940985131904:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.814591:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814602:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d3609dba/0x57e58d5a90c7ecaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.814602:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.814610:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 47 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814613:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814625:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.814628:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.814633:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.814635:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 47 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814639:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 40 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814655:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1df:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.814659:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b09ae6e6/0x57e58d5a90c7c31f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb25a3 expref: 47 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814660:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.814670:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.814675:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.814682:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.814687:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814697:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 40 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.814716:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.814721:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 40 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.814740:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374144:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.814747:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.814756:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814766:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814774:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.814782:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.814782:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:2365:x1868940985131904:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 196us (364us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.814802:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 213
00000100:00100000:2.0:1782361985.814804:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.814816:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.814823:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.814853:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814863:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.814867:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814876:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814906:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814914:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000013281893/0x57e58d5a90c7ecb6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.814934:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.814936:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.814939:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.815058:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.815071:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 45 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.815077:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e4:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.815080:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.815084:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.815101:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 45 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.815111:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 45 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.815121:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374272:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.815162:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fea80 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.815618:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374144:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.815632:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.815892:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374272:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.815910:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.815913:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.815945:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132032
00000100:00100000:1.0:1782361985.815950:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132032
00010000:00010000:1.0:1782361985.815969:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 41 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.815999:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 214
00000100:00100000:1.0:1782361985.816007:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:2365:x1868940985132032:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.816016:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.816023:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 41 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816037:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 41 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816049:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016da760a/0x57e58d5a90c7c0b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24bc expref: 41 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.816058:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:1.0:1782361985.816073:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.816077:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.816094:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.816098:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132160
00000100:00100000:0.0:1782361985.816104:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132160
00010000:00010000:1.0:1782361985.816106:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816124:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 46 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816129:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.816139:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816151:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.816156:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 215
00000100:00100000:1.0:1782361985.816165:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:2365:x1868940985132032:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 156us (254us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.816169:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.816171:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504751850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:2364:x1868940985132160:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:1.0:1782361985.816184:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 214
00010000:00010000:0.0:1782361985.816186:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.816189:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816193:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 46 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816221:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 46 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816228:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.816237:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b19c8a10/0x57e58d5a90c7c2af lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2579 expref: 46 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816238:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.816247:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816252:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.816259:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.816264:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816280:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.816282:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816285:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816299:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816328:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.816356:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816357:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.816358:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504751850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:2364:x1868940985132160:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 191us (331us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.816367:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.816378:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 215
00010000:00010000:3.0:1782361985.816385:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ecbd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816390:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 39 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816391:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816414:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.816414:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1de:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.816416:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816419:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.816423:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.816423:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.816440:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816448:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816458:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.816468:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.816475:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816485:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.816489:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816496:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816546:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816556:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816571:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 44 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.816572:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ecc4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816577:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 39 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816591:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.816600:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.816605:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.816608:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 39 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.816631:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 44 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.816632:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374400:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.816648:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 44 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.816648:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.816652:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.816656:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.816663:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374528:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.816688:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.816693:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.817627:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374400:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.817645:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.817654:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374528:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.817675:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.817860:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.817892:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.817914:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132288
00000100:00100000:2.0:1782361985.817921:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132288
00010000:00010000:2.0:1782361985.817942:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 40 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.817975:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132416
00000100:00100000:2.0:1782361985.817979:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132416
00010000:00010000:2.0:1782361985.817993:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 45 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.818003:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 216
00000100:00100000:3.0:1782361985.818014:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:2364:x1868940985132288:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.818025:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:2.0:1782361985.818030:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 217
00010000:00010000:3.0:1782361985.818034:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 40 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.818043:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:2364:x1868940985132416:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.818057:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 40 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818058:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.818066:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 45 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818078:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008e8f34d9/0x57e58d5a90c7c047 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2492 expref: 40 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818081:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 45 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818102:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.818108:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a107318f/0x57e58d5a90c7c23f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb254f expref: 45 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818116:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.818123:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818123:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.818130:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.818137:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818141:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818163:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818190:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.818215:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.818216:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818224:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818228:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.818229:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+44:2364:x1868940985132416:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 187us (333us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.818241:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:2364:x1868940985132288:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 226us (384us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.818251:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 217
00010000:00010000:3.0:1782361985.818255:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818255:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.818262:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 216
00010000:00010000:3.0:1782361985.818279:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818297:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.818300:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818316:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.818326:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.818331:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818337:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.818341:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818351:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818363:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818390:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071fd7544/0x57e58d5a90c7ecd2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818408:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.818411:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.818413:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.818429:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818429:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.818445:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 43 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818452:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.818456:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.818460:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818486:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 43 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.818499:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 43 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.818511:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374656:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.818532:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.818538:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818539:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818559:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.818561:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 38 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818564:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818577:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1dd:0x0].0x0 since=198s v=(0 0)
00000100:00100000:1.0:1782361985.818579:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.818586:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.818587:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818594:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818604:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818614:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eccb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.818618:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 38 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818639:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.818645:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 38 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.818648:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.818652:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.818656:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374784:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.818689:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fed80 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.819452:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374656:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.819476:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.819727:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.819731:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992374784:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.819753:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.819758:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132544
00000100:00100000:1.0:1782361985.819763:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132544
00010000:00010000:1.0:1782361985.819781:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 44 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.819814:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 218
00000100:00100000:1.0:1782361985.819820:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+44:2365:x1868940985132544:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.819847:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.819852:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 44 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.819862:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 44 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.819876:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a473830/0x57e58d5a90c7c1cf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2525 expref: 44 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.819887:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.819890:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.819895:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.819904:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.819927:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.819950:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.819957:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:2365:x1868940985132544:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 135us (228us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.819965:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 218
00010000:00010000:3.0:1782361985.820005:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820013:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820028:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820045:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.820052:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.820080:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132672
00000100:00100000:1.0:1782361985.820083:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132672
00010000:00010000:3.0:1782361985.820088:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.820095:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820103:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.820107:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 39 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820108:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820130:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820143:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.820147:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219
00010000:00010000:3.0:1782361985.820156:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7ecd9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.820157:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:2365:x1868940985132672:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.820168:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.820173:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 39 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820178:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.820181:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 39 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820183:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.820186:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.820195:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7bfd7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2468 expref: 39 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820202:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.820204:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.820207:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820221:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820239:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.820262:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.820273:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc86300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:2365:x1868940985132672:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 115us (224us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.820276:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.820288:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219
00010000:00010000:0.0:1782361985.820290:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.820299:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820315:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.820317:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.820328:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.820335:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820336:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 42 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820356:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.820361:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820370:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820383:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820388:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004e46d150/0x57e58d5a90c7ece0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820398:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e1:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.820403:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.820404:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.820407:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820412:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.820413:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.820415:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.820429:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 37 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.820437:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1dc:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.820439:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 42 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.820451:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.820456:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.820458:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 42 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.820481:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374912:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.820489:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 37 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.820501:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 37 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.820511:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375040:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.820537:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b6e6b40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.820540:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe3c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.821255:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4064ffb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992374912:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.821267:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.821607:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.821651:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132928
00000100:00100000:0.0:1782361985.821661:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132928
00000100:00100000:3.0:1782361985.821674:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.821683:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 43 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.821715:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985132800
00000100:00100000:0.0:1782361985.821720:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 220
00000100:00100000:1.0:1782361985.821722:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985132800
00000100:00100000:0.0:1782361985.821732:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:2364:x1868940985132928:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.821742:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 38 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.821744:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.821754:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 43 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.821767:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 43 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.821783:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375040:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.821796:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 221
00010000:00010000:0.0:1782361985.821808:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024831e82/0x57e58d5a90c7c15f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24fb expref: 43 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.821810:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:2365:x1868940985132800:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.821818:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.821820:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.821825:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.821848:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821849:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.821859:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 38 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.821861:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821884:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 38 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821899:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069bf1201/0x57e58d5a90c7bf67 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb243e expref: 38 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821909:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.821911:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.821913:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.821914:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821918:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.821924:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821927:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.821933:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.821941:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.821944:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.821954:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.821959:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2364:x1868940985132928:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 226us (348us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.821966:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:2365:x1868940985132800:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 158us (329us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.821973:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 220
00000100:00100000:3.0:1782361985.821981:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 221
00010000:00010000:0.0:1782361985.822000:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.822006:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822016:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.822020:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822029:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822053:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822060:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000096646366/0x57e58d5a90c7ece7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822065:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822074:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.822078:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.822081:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 41 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.822081:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.822090:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1e0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.822093:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.822103:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822124:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 41 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822135:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 41 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.822142:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375168:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.822168:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.822244:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822252:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822257:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822261:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822273:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.822289:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.822295:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822303:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.822307:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822316:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822329:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.822337:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000079e073c1/0x57e58d5a90c7ecee lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822342:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822364:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 36 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822371:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1db:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.822371:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.822377:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.822377:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.822380:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.822386:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822400:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 36 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.822407:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 36 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.822416:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375296:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.822450:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d43c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.824064:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.824118:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.824165:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375296:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.824170:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133056
00000100:00100000:0.0:1782361985.824176:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133056
00010000:00010000:2.0:1782361985.824184:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.824209:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 42 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.824237:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133184
00000100:00100000:0.0:1782361985.824241:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133184
00000100:00100000:2.0:1782361985.824248:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 222
00010000:00010000:0.0:1782361985.824254:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 37 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.824262:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504750850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2365:x1868940985133056:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.824280:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.824291:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 42 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.824304:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 42 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.824313:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 223
00000100:00100000:0.0:1782361985.824322:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:2364:x1868940985133184:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.824323:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.824331:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.824339:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.824339:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 37 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.824349:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.824357:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 37 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.824363:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.824393:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f0913584/0x57e58d5a90c7bef7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2414 expref: 37 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.824394:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.824414:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.824418:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.824423:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.824429:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504750850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2365:x1868940985133056:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 170us (366us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.824437:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.824441:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 222
00010000:00010000:0.0:1782361985.824463:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.824487:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:2364:x1868940985133184:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 166us (368us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.824493:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 223
00010000:00010000:0.0:1782361985.825706:0:14579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef463231/0x57e58d5a90c7c0ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24d1 expref: 41 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.825721:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375168:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.825743:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.825755:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.825765:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.825796:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.825799:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.825816:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.825819:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.825852:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.825871:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.825899:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.825919:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:2.0:1782361985.826038:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.826052:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 35 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.826063:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1da:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.826065:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.826068:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826088:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.826089:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 35 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.826110:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 35 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826114:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 40 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.826123:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375424:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.826127:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1df:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.826132:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.826136:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826161:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 40 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826171:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 40 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.826190:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375552:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.826203:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.826213:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:3.0:1782361985.826221:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.826224:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe3c0 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.826238:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.826243:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826250:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.826254:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826256:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826273:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.826275:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826277:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.826294:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ecfc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826297:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.826319:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.826320:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.826323:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.826325:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.826331:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7ecf5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.826348:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.826350:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.826352:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.828916:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375424:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.828935:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375552:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.828939:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.828953:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.829325:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.829348:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.829381:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133312
00000100:00100000:3.0:1782361985.829386:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133440
00000100:00100000:0.0:1782361985.829387:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133312
00000100:00100000:3.0:1782361985.829390:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133440
00010000:00010000:3.0:1782361985.829419:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 36 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.829420:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 41 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.829467:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 224
00000100:00100000:0.0:1782361985.829478:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:2365:x1868940985133312:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1782361985.829493:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 225
00010000:00010000:0.0:1782361985.829499:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:3.0:1782361985.829505:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:2363:x1868940985133440:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.829508:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 41 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829517:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.829522:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 41 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829525:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 36 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.829552:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b7bf913/0x57e58d5a90c7c07f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb24a7 expref: 41 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829559:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 36 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.829564:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.829572:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1df:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.829577:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829580:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f94d6461/0x57e58d5a90c7be87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ea expref: 36 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.829595:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829600:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.829604:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.829609:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829620:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.829652:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.829656:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.829684:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829686:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.829694:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:2365:x1868940985133312:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 215us (368us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361985.829695:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2363:x1868940985133440:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 189us (341us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.829705:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.829711:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 224
00010000:00010000:1.0:1782361985.829723:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.829725:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 225
00010000:00010000:2.0:1782361985.829728:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829740:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.829743:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829751:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.829780:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1782361985.829798:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.829801:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:0.0:1782361985.829806:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829811:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.829812:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.829821:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.829822:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829857:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.829862:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829871:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829892:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829899:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fbb25c2/0x57e58d5a90c7ed0a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1df:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.829919:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.829921:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.829923:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.830022:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.830027:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.830044:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 34 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.830047:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.830058:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.830059:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed03 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.830075:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d9:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.830080:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.830083:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.830085:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.830087:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.830091:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.830113:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 34 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.830133:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 34 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.830146:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375680:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.830189:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00010000:00010000:1.0:1782361985.830410:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 39 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.830418:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1de:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.830422:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.830426:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.830446:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 39 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.830456:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 39 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.830482:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375808:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.830516:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.831152:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.831168:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074dbb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992375808:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.831187:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.831212:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133568
00000100:00100000:0.0:1782361985.831223:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133568
00010000:00010000:0.0:1782361985.831237:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 35 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.831260:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 226
00000100:00100000:0.0:1782361985.831265:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2364:x1868940985133568:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.831272:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.831275:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 35 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831281:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 35 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831290:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.831292:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.831295:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831300:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831307:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:0.0:1782361985.831331:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2364:x1868940985133568:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 65us (180us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.831337:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 226
00000100:00100000:3.0:1782361985.831519:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.831540:0:6591:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003359de09/0x57e58d5a90c7be17 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23c0 expref: 34 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.831555:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375680:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.831559:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133696
00000100:00100000:1.0:1782361985.831564:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133696
00010000:00010000:1.0:1782361985.831586:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 40 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831591:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831606:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831615:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831622:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.831623:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 227
00010000:00010000:2.0:1782361985.831634:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.831637:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:2365:x1868940985133696:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.831652:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.831657:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.831659:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 40 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.831671:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 40 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.831681:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b0d5126/0x57e58d5a90c7c00f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb247d expref: 40 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.831701:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.831705:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1de:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.831709:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.831718:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.831744:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.831757:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831765:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831770:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 33 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.831778:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:2365:x1868940985133696:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 142us (258us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.831784:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.831800:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831804:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d8:0x0].0x0 since=198s v=(0 0)
00000100:00100000:1.0:1782361985.831809:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 227
00010000:00010000:0.0:1782361985.831813:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831814:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.831825:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.831854:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.831861:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.831879:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831889:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831897:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 33 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.831898:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831912:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.831925:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b20d4eec/0x57e58d5a90c7ed11 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.831929:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 33 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.831939:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.831950:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375936:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.831954:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.831959:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.831967:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.831968:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.831973:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.831991:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.831996:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.832014:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.832023:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7ed18 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1de:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.832060:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.832082:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 38 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.832089:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.832090:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1dd:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.832094:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.832096:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.832098:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.832101:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.832131:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 38 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.832141:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 38 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.832158:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376064:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.832191:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.832662:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992375936:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.832674:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.833096:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.833143:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133824
00000100:00100000:0.0:1782361985.833149:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133824
00010000:00010000:0.0:1782361985.833178:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 34 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.833204:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376064:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.833211:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 228
00000100:00100000:0.0:1782361985.833222:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+34:2364:x1868940985133824:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.833228:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833231:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.833241:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 34 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833253:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 34 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833267:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003bb27068/0x57e58d5a90c7bda7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2396 expref: 34 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833277:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.833280:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.833294:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833319:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833343:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.833373:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.833379:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:2364:x1868940985133824:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 157us (281us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.833390:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.833395:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 228
00010000:00010000:2.0:1782361985.833406:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.833426:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.833452:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.833473:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.833480:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.833488:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:0.0:1782361985.833495:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.833500:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833509:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833523:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833532:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed1f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833548:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.833555:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.833558:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.833568:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985133952
00000100:00100000:0.0:1782361985.833572:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985133952
00010000:00010000:0.0:1782361985.833588:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 39 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.833593:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.833609:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 32 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.833617:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 229
00010000:00010000:2.0:1782361985.833619:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d7:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.833624:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00000100:00100000:0.0:1782361985.833630:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:2365:x1868940985133952:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.833639:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.833644:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 39 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833654:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 39 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833668:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d51608d/0x57e58d5a90c7bf9f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2453 expref: 39 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833677:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.833680:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.833685:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833693:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833723:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.833733:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.833744:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.833749:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504751c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:2365:x1868940985133952:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 122us (266us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.833762:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.833763:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 229
00010000:00010000:3.0:1782361985.833774:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.833803:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.833812:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.833818:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833826:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.833862:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833870:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833883:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833892:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006d15f189/0x57e58d5a90c7ed26 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1dd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.833908:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.833911:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.833913:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.833939:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.833998:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 37 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.834006:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1dc:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.834009:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.834012:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.834077:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 37 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.834098:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 37 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.834110:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376192:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.834155:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe300 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.834863:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376192:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.834882:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.834991:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.835018:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 32 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.835028:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 32 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.835039:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376320:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.835078:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.835265:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.835304:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134080
00000100:00100000:1.0:1782361985.835308:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134080
00010000:00010000:1.0:1782361985.835325:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 38 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.835346:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 230
00000100:00100000:1.0:1782361985.835352:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:2364:x1868940985134080:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.835364:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.835368:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 38 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835375:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 38 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835385:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ef3d6a62/0x57e58d5a90c7bf2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2429 expref: 38 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835392:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.835394:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1dc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.835397:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835402:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835417:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.835440:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.835454:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:2364:x1868940985134080:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 98us (185us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.835454:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.835470:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 230
00010000:00010000:0.0:1782361985.835473:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835483:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835513:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.835533:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.835539:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835560:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cec00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.835565:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835574:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835586:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835593:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000092c0b27e/0x57e58d5a90c7ed34 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1dc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835607:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.835609:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.835611:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.835615:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.835625:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 36 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835631:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1db:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.835633:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.835636:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835649:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 36 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.835654:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 36 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.835661:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376448:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.835686:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.835802:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376320:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.835824:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.836005:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.836040:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134208
00000100:00100000:0.0:1782361985.836045:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134208
00010000:00010000:0.0:1782361985.836063:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 33 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.836091:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 231
00000100:00100000:0.0:1782361985.836099:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:2365:x1868940985134208:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.836107:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.836119:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 33 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.836128:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 33 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.836140:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003c0456bf/0x57e58d5a90c7bd37 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb236c expref: 33 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.836149:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.836152:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.836156:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.836163:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.836185:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.836212:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.836217:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:2365:x1868940985134208:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (211us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.836233:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.836233:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 231
00010000:00010000:2.0:1782361985.836247:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836255:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836269:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.836292:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.836299:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836340:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836350:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 31 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.836359:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.836359:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d6:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.836367:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836376:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.836378:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836383:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.836394:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.836414:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000043879ce/0x57e58d5a90c7ed2d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836430:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 31 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.836447:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 31 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.836449:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.836452:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.836454:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.836461:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376576:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.836492:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.836985:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.836993:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376448:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.837012:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837040:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134336
00000100:00100000:1.0:1782361985.837046:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134336
00010000:00010000:1.0:1782361985.837067:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 37 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837107:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 232
00000100:00100000:1.0:1782361985.837116:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:2365:x1868940985134336:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.837125:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.837130:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 37 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837150:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 37 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837165:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cdd72a24/0x57e58d5a90c7bebf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ff expref: 37 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837176:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.837179:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1db:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.837183:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837191:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837212:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.837232:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837248:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:2365:x1868940985134336:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 132us (263us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.837261:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837270:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 232
00010000:00010000:0.0:1782361985.837276:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837286:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837310:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.837393:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837406:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 35 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837408:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.837417:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837418:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1da:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.837429:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.837431:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.837435:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837438:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837464:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837479:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837480:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 35 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837502:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000076342eb3/0x57e58d5a90c7ed3b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1db:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.837504:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 35 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.837518:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.837522:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.837525:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.837525:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376704:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.837566:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe3c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.837870:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376576:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.837879:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.837887:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837919:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134464
00000100:00100000:1.0:1782361985.837925:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134464
00010000:00010000:1.0:1782361985.837943:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 32 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.837971:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 233
00000100:00100000:1.0:1782361985.837979:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:2364:x1868940985134464:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.837987:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.837993:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 32 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838004:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 32 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838029:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021888e09/0x57e58d5a90c7bcc7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2342 expref: 32 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838041:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.838044:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.838049:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838058:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838088:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.838119:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:2364:x1868940985134464:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 140us (242us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.838126:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.838127:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 233
00010000:00010000:2.0:1782361985.838139:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838149:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838157:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838183:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.838205:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.838210:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.838216:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.838219:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.838224:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.838232:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.838237:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7ed42 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.838249:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.838250:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.838251:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.838286:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838298:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 30 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838305:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d5:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.838308:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.838312:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838332:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 30 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.838342:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 30 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.838353:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376832:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.838395:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4240 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.838740:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.838757:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376704:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.838776:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.838782:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134592
00000100:00100000:1.0:1782361985.838797:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134592
00010000:00010000:1.0:1782361985.838845:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 36 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.838873:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 234
00000100:00100000:1.0:1782361985.838881:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:2364:x1868940985134592:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.838889:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.838893:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 36 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838918:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 36 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838933:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf7bb0e9/0x57e58d5a90c7be4f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23d5 expref: 36 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838945:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.838949:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1da:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.838954:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838962:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.838988:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.839020:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2364:x1868940985134592:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (281us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.839022:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.839033:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 234
00010000:00010000:2.0:1782361985.839036:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839060:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839067:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839085:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.839105:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.839111:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839130:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.839134:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839154:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839169:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839177:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077500e4f/0x57e58d5a90c7ed49 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1da:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839203:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.839205:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.839234:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.839253:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839266:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 34 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839273:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d9:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.839277:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.839280:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839302:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 34 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.839311:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 34 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.839323:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376960:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.839381:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4300 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.839414:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992376832:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.839434:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.839660:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.839695:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134720
00000100:00100000:1.0:1782361985.839700:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134720
00010000:00010000:1.0:1782361985.839717:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 31 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.839751:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 235
00000100:00100000:1.0:1782361985.839761:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:2365:x1868940985134720:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.839770:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.839775:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 31 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839798:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 31 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839826:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004dce9b37/0x57e58d5a90c7bc57 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2318 expref: 31 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839855:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.839859:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.839863:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839872:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.839894:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.839906:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.839918:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.839928:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:2365:x1868940985134720:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 168us (269us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.839929:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.839943:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 235
00010000:00010000:3.0:1782361985.839945:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.839965:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.839989:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:2.0:1782361985.840000:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840007:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.840011:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840018:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840029:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840034:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002962b599/0x57e58d5a90c7ed50 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840063:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.840065:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.840069:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.840202:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.840217:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 29 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.840237:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d4:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.840241:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.840246:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.840272:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3cb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992376960:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.840273:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 29 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.840289:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 29 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840295:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.840301:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.840312:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53d900700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377088:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.840338:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134848
00000100:00100000:2.0:1782361985.840343:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134848
00010000:00010000:2.0:1782361985.840365:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 35 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.840398:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 236
00000100:00100000:2.0:1782361985.840406:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504753850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2364:x1868940985134848:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.840414:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.840419:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 35 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840440:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 35 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840458:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009900e687/0x57e58d5a90c7bddf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb23ab expref: 35 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.840460:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b240 going to sleep for 11 seconds
00010000:00010000:2.0:1782361985.840474:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.840478:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d9:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.840482:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840490:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.840508:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.840518:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840528:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.840534:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504753850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+34:2364:x1868940985134848:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 127us (238us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.840555:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 236
00010000:00010000:1.0:1782361985.840558:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840566:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840582:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.840594:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.840599:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840606:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.840610:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840618:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840630:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840637:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7ed57 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840659:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.840667:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.840670:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.840812:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840850:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 33 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840858:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d8:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.840862:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.840866:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840888:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 33 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.840899:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 33 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.840910:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377216:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.840966:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1a840 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.841071:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53d900700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377088:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.841096:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.841443:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.841479:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985134976
00000100:00100000:1.0:1782361985.841484:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985134976
00010000:00010000:1.0:1782361985.841505:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 30 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.841536:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 237
00000100:00100000:1.0:1782361985.841544:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:2365:x1868940985134976:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.841558:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.841564:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 30 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.841576:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 30 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.841591:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c7eb266e/0x57e58d5a90c7bbe7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22ee expref: 30 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.841603:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.841606:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.841609:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.841614:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.841629:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.841652:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.841660:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:2365:x1868940985134976:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (216us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.841668:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.841674:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 237
00010000:00010000:2.0:1782361985.841684:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841692:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841713:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:2.0:1782361985.841806:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841819:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 28 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841840:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.841850:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.841866:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841884:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 28 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.841890:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 28 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.841902:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377344:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.841942:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.842078:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d9500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377216:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.842092:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.842126:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.842148:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135104
00000100:00100000:1.0:1782361985.842153:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135104
00010000:00010000:1.0:1782361985.842169:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 34 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.842193:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 238
00000100:00100000:1.0:1782361985.842202:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+34:2365:x1868940985135104:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.842210:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.842215:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 34 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842225:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 34 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842238:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000725d6f85/0x57e58d5a90c7bd6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2381 expref: 34 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842247:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.842251:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d8:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.842255:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842262:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842291:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.842303:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842314:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.842321:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:2365:x1868940985135104:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 118us (194us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.842328:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.842333:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 238
00010000:00010000:2.0:1782361985.842342:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842359:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:1.0:1782361985.842366:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.842371:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842380:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfc00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.842383:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842392:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842404:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842412:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000016179d03/0x57e58d5a90c7ed5e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842430:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.842434:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842453:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:2.0:1782361985.842454:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842457:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842476:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842484:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 32 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842493:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d7:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.842493:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842502:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.842511:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842512:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000024a5ff7c/0x57e58d5a90c7ed65 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.842533:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.842536:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.842538:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.842546:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 32 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.842557:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 32 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.842568:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377472:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.842596:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4e40 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.842700:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377344:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.842710:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.842720:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.843229:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.843267:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135232
00000100:00100000:2.0:1782361985.843273:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135232
00010000:00010000:2.0:1782361985.843291:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 29 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.843329:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 239
00000100:00100000:2.0:1782361985.843337:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:2365:x1868940985135232:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.843345:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.843350:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 29 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.843361:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 29 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.843374:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000052b4cfc2/0x57e58d5a90c7bb77 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22c4 expref: 29 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.843385:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.843388:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.843392:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.843400:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.843421:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.843438:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843446:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.843452:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:2365:x1868940985135232:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 114us (222us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.843456:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.843464:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 239
00010000:00010000:3.0:1782361985.843476:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843495:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.843520:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.843527:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.843535:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.843539:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.843547:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.843561:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.843569:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006dc45fd1/0x57e58d5a90c7ed6c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843583:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.843585:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.843589:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.843592:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.843636:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 27 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843642:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.843644:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.843647:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843667:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 27 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.843677:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 27 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.843689:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52f4ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377600:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.843736:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b240 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.843949:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377472:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.843960:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00010000:00010000:2.0:1782361985.843961:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.843992:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135360
00000100:00100000:1.0:1782361985.843997:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135360
00010000:00010000:1.0:1782361985.844015:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 33 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.844043:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 240
00000100:00100000:1.0:1782361985.844051:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:2365:x1868940985135360:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.844059:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.844063:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 33 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844076:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 33 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844085:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000685024e6/0x57e58d5a90c7bcff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2357 expref: 33 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844092:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.844094:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d7:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.844097:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844102:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844114:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.844125:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844133:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.844136:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:2365:x1868940985135360:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 85us (178us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.844147:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.844147:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 240
00010000:00010000:2.0:1782361985.844157:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844173:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.844180:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.844184:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844190:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.844192:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844206:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844215:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844222:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f0bee5ea/0x57e58d5a90c7ed73 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.844236:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.844238:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.844247:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.844281:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844290:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 31 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844295:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d6:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.844299:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.844303:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844332:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 31 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.844342:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 31 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.844350:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377728:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.844385:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.845183:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52f4ff480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377600:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.845198:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.845306:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377728:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.845317:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.845564:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.845608:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135488
00000100:00100000:1.0:1782361985.845614:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135488
00010000:00010000:1.0:1782361985.845635:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 32 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.845669:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 241
00000100:00100000:3.0:1782361985.845675:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.845682:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:2365:x1868940985135488:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.845693:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.845698:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 32 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.845702:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135616
00000100:00100000:0.0:1782361985.845710:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135616
00010000:00010000:1.0:1782361985.845714:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 32 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845735:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 28 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.845743:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f218675/0x57e58d5a90c7bc8f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb232d expref: 32 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.845755:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.845764:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d6:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.845770:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.845779:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.845801:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 242
00000100:00100000:0.0:1782361985.845812:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:2365:x1868940985135616:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.845816:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.845847:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.845856:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845856:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 28 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.845871:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:2365:x1868940985135488:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 188us (305us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.845877:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845889:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 28 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.845890:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 241
00010000:00010000:3.0:1782361985.845892:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.845910:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845922:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000a289ea/0x57e58d5a90c7bb07 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb229a expref: 28 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.845926:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.845937:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.845941:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.845946:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845954:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.845993:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.845993:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.846002:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.846009:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.846020:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.846026:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:2365:x1868940985135616:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 215us (351us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.846033:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00000100:00100000:0.0:1782361985.846035:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 242
00010000:00010000:1.0:1782361985.846055:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.846067:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846067:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.846076:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.846077:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.846084:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846090:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.846097:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.846099:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.846108:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846116:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.846139:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 30 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846146:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.846152:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d5:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.846154:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.846155:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846160:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a67e991d/0x57e58d5a90c7ed7a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.846162:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.846173:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.846184:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000043879ce/0x57e58d5a90c7ed81 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.846186:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 26 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.846194:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.846198:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.846202:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.846208:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d1:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.846212:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.846217:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 30 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.846217:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.846218:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.846220:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.846223:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.846255:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 26 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.846260:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 30 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.846267:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 26 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.846273:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377856:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.846278:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377984:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.846319:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b240 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.846321:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4b40 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.847479:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992377856:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.847497:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.847505:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992377984:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.847516:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.847889:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.847920:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135744
00000100:00100000:1.0:1782361985.847925:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135744
00010000:00010000:1.0:1782361985.847947:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 31 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.847977:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 243
00000100:00100000:1.0:1782361985.847985:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e504751050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:2365:x1868940985135744:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:1.0:1782361985.847994:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.847999:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 31 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848011:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 31 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848026:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000018946235/0x57e58d5a90c7bc1f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2303 expref: 31 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848054:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.848058:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d5:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.848063:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848072:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848093:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.848123:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e504751050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:2365:x1868940985135744:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (234us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.848128:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.848133:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 243
00010000:00010000:3.0:1782361985.848143:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.848153:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.848161:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.848178:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.848194:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.848201:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848215:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cf000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.848218:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848224:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848233:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848241:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000098bb09dc/0x57e58d5a90c7ed88 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848255:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.848257:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.848259:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361985.848388:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.848425:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985135872
00000100:00100000:2.0:1782361985.848431:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985135872
00010000:00010000:2.0:1782361985.848470:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 27 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.848502:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 244
00000100:00100000:2.0:1782361985.848512:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:2362:x1868940985135872:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.848521:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.848527:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 27 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848537:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.848539:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 27 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848564:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 29 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.848569:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004f52f03b/0x57e58d5a90c7ba97 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2270 expref: 27 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848577:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d4:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.848585:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.848590:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.848591:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.848598:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.848609:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.848617:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848624:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 29 pid: 10734 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.848642:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.848645:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 29 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.848660:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378112:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.848665:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848673:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.848678:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:2362:x1868940985135872:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 165us (286us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.848681:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.848689:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 244
00000100:00100000:1.0:1782361985.848697:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e528f1ab40 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.848700:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.848722:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.848731:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.848737:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848746:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.848752:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848761:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848775:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848783:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7ed8f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.848816:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.848818:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.848820:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.849137:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.849149:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 25 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.849156:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1d0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.849158:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.849162:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.849182:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 25 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.849192:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 25 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.849203:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378240:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.849239:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.850025:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378112:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.850040:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.851005:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378240:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.851033:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.851078:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.851112:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.851150:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136000
00000100:00100000:2.0:1782361985.851165:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136000
00000100:00100000:0.0:1782361985.851167:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136128
00000100:00100000:0.0:1782361985.851170:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136128
00010000:00010000:2.0:1782361985.851193:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 30 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851193:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 26 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.851223:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 245
00000100:00100000:2.0:1782361985.851227:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 246
00000100:00100000:2.0:1782361985.851234:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:2365:x1868940985136000:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.851237:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:2363:x1868940985136128:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.851246:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.851246:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.851253:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 30 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851253:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 26 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.851265:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 30 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851266:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 26 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.851282:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ca8d9369/0x57e58d5a90c7bbaf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22d9 expref: 30 pid: 10734 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851287:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005958c761/0x57e58d5a90c7ba27 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2246 expref: 26 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.851293:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.851297:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d4:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.851299:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.851301:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851301:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.851305:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851314:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.851320:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.851336:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.851338:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.851359:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851379:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851385:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851390:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851402:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.851413:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.851420:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.851424:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:2365:x1868940985136000:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 189us (346us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.851428:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc16b0e90)
00000100:00100000:2.0:1782361985.851432:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 246
00010000:00010000:1.0:1782361985.851433:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.851442:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.851453:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.851460:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000039e58fe/0x57e58d5a90c7ed9d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.851477:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.851479:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.851482:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.851509:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+25:2363:x1868940985136128:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 138us (254us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.851517:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 245
00010000:00010000:3.0:1782361985.851523:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851533:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 24 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851540:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1cf:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.851543:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.851547:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851603:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 24 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851611:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 24 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.851634:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378368:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.851678:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b240 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.851695:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851703:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851710:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851717:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851736:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.851807:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.851812:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851818:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.851821:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851855:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851869:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851872:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851881:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000681b4425/0x57e58d5a90c7ed96 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851890:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 28 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851903:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d3:0x0].0x0 since=198s v=(0 0)
00010000:00010000:3.0:1782361985.851906:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.851908:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.851911:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.851912:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.851915:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.851945:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 28 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.851954:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 28 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.851964:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378496:192.168.202.24@tcp:104:
00000100:00100000:3.0:1782361985.852001:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b180 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.852955:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378368:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.852970:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.853236:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378496:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.853247:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.853457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.853487:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.853497:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136256
00000100:00100000:2.0:1782361985.853504:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136256
00000100:00100000:3.0:1782361985.853526:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136384
00010000:00010000:2.0:1782361985.853529:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 25 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.853532:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136384
00010000:00010000:3.0:1782361985.853552:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 29 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.853576:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 247
00000100:00100000:3.0:1782361985.853585:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 248
00000100:00100000:2.0:1782361985.853590:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+25:2365:x1868940985136256:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1782361985.853599:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:2364:x1868940985136384:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.853602:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.853610:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 25 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853634:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 25 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853655:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006b59f351/0x57e58d5a90c7b9b7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb221c expref: 25 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853656:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.853668:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.853672:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 29 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853685:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.853691:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 29 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853692:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853715:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853719:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003b0d390b/0x57e58d5a90c7bb3f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb22af expref: 29 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853736:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.853739:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d3:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.853743:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.853746:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.853754:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.853761:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.853771:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.853782:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+24:2365:x1868940985136256:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 195us (322us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.853783:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853783:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.853810:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 247
00010000:00010000:3.0:1782361985.853811:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.853821:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:2364:x1868940985136384:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 224us (332us total) trans 0 rc 0/0
00010000:00010000:3.0:1782361985.853860:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:0.0:1782361985.853870:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 248
00010000:00010000:1.0:1782361985.853903:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853904:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.853913:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.853915:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853921:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cfe00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.853927:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.853932:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.853949:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853954:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853968:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853974:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000045fe3f27/0x57e58d5a90c7eda4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.853976:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.853991:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.853992:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.853997:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.853997:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.854018:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097cea00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.854023:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.854025:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 23 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.854045:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1ce:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.854046:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.854052:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.854061:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.854067:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.854074:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000086fa214b/0x57e58d5a90c7edab lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.854097:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.854099:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.854100:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.854104:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.854117:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 27 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.854125:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d2:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.854128:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.854132:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.854138:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 23 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.854161:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 23 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.854162:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 27 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.854191:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 27 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.854205:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378624:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.854226:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378752:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.854269:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4780 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.854272:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5420d4480 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.855883:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378624:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.855899:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.855924:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074dad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992378752:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.855941:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.856369:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.856399:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.856484:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136640
00000100:00100000:2.0:1782361985.856491:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136640
00000100:00100000:0.0:1782361985.856510:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136512
00010000:00010000:2.0:1782361985.856514:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 28 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.856516:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136512
00010000:00010000:0.0:1782361985.856533:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 24 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.856561:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 249
00000100:00100000:0.0:1782361985.856570:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 250
00000100:00100000:2.0:1782361985.856574:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:2362:x1868940985136640:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.856581:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+24:2364:x1868940985136512:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.856592:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.856598:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.856598:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 24 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856608:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 28 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856616:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 24 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856626:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 28 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856636:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000192003b6/0x57e58d5a90c7b947 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21f2 expref: 24 pid: 6591 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856644:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f67f3328/0x57e58d5a90c7bacf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2285 expref: 28 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856650:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.856656:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.856656:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.856663:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d2:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.856663:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856673:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856684:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856690:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856714:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.856728:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.856753:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.856753:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:2362:x1868940985136640:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 180us (382us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.856754:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518628c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+23:2364:x1868940985136512:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 176us (352us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.856760:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.856773:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 250
00010000:00010000:3.0:1782361985.856781:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.856793:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 249
00010000:00010000:1.0:1782361985.856796:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.856813:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.856814:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.856853:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.856855:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.856890:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.856910:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.856918:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856927:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e5097ce200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.856931:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856938:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856948:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856953:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d94b7e31/0x57e58d5a90c7edb2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.856966:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.856967:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.856976:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856981:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621400 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.856984:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.856987:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.856989:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.856999:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.857004:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5d74a56/0x57e58d5a90c7edb9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.857015:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.857016:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.857018:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.857059:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.857070:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 22 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.857075:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1cd:0x0].0x0 since=199s v=(0 0)
00010000:00010000:1.0:1782361985.857077:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.857086:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.857096:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.857110:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 22 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.857112:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 26 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.857133:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d1:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.857137:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.857140:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 22 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.857143:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.857165:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378880:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.857175:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 26 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.857184:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 26 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.857192:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379008:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.857209:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e50812e600 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.857222:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.857944:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074d8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992378880:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.857959:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.858000:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379008:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.858009:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.858179:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.858198:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.858224:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136768
00000100:00100000:1.0:1782361985.858230:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136768
00000100:00100000:0.0:1782361985.858238:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985136896
00000100:00100000:0.0:1782361985.858244:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985136896
00010000:00010000:1.0:1782361985.858253:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 23 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858261:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 27 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.858284:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 251
00000100:00100000:1.0:1782361985.858296:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+23:2365:x1868940985136768:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:3.0:1782361985.858303:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 252
00010000:00010000:1.0:1782361985.858307:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.858315:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 23 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.858316:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:2363:x1868940985136896:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.858331:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.858333:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 23 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858340:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 27 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858353:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000000df535b/0x57e58d5a90c7b8d7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21c8 expref: 23 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858376:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.858382:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 27 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858383:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.858392:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858402:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858404:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f15904f7/0x57e58d5a90c7ba5f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb225b expref: 27 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858425:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.858429:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d1:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.858433:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858440:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:3.0:1782361985.858442:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858471:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361985.858472:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+22:2365:x1868940985136768:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 178us (291us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361985.858482:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 251
00010000:00010000:0.0:1782361985.858497:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.858501:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:2363:x1868940985136896:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 187us (297us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.858505:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858518:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.858521:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 252
00010000:00010000:2.0:1782361985.858524:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858548:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858550:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858569:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858569:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858599:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:0.0:1782361985.858607:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool
00010000:00010000:3.0:1782361985.858619:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp.  (1 blwis in pool)
00010000:00010000:1.0:1782361985.858656:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.858663:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858667:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858679:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.858684:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621200 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.858686:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858692:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858702:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858723:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858728:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858728:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858734:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858754:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1cc:0x0].0x0 since=199s v=(0 0)
00010000:00010000:2.0:1782361985.858756:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.858761:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858761:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.858762:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858781:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d3609dba/0x57e58d5a90c7edc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d1:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858805:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b94276a/0x57e58d5a90c7edc0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858808:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 25 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.858815:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.858819:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.858824:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.858848:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1d0:0x0].0x0 since=198s v=(0 0)
00010000:00010000:2.0:1782361985.858855:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 21 pid: 6590 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858863:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.858867:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.858870:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858872:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.858872:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 21 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.858876:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:2.0:1782361985.858898:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992379136:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.858906:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 25 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.858924:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 25 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.858935:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379264:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.858969:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe300 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.858971:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.860318:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361985.860325:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992379136:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.860345:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.860355:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.860384:0:6604:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137152
00000100:00100000:2.0:1782361985.860389:0:6604:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137152
00000100:00100000:1.0:1782361985.860402:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137024
00000100:00100000:1.0:1782361985.860408:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137024
00010000:00010000:2.0:1782361985.860410:0:6604:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 22 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.860434:0:5775:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 26 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.860444:0:6604:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 253
00000100:00100000:2.0:1782361985.860455:0:6604:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+22:2364:x1868940985137152:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.860464:0:6604:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00100000:1.0:1782361985.860468:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 254
00010000:00010000:2.0:1782361985.860473:0:6604:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 22 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.860481:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:2365:x1868940985137024:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.860493:0:6604:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 22 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.860494:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:1.0:1782361985.860503:0:5775:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 26 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860513:0:6604:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000afbf502a/0x57e58d5a90c7b867 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb219e expref: 22 pid: 6590 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.860520:0:5775:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 26 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860523:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.860530:0:6604:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.860537:0:6604:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860543:0:6604:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.860544:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.860549:0:5775:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d0:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.860556:0:5775:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860574:0:6604:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.860579:0:5775:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.860597:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361985.860607:0:6604:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+21:2364:x1868940985137152:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 153us (291us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.860615:0:6604:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 253
00000100:00100000:1.0:1782361985.860623:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:2365:x1868940985137024:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 145us (267us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.860648:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860657:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860666:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860673:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.860680:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 254
00010000:00010000:2.0:1782361985.860699:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.860725:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.860732:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860742:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.860747:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860757:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860779:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860801:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000171cf10c/0x57e58d5a90c7edce lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860819:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.860821:0:6591:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.860822:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.860825:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:2.0:1782361985.860854:0:6591:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 20 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860862:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x1cb:0x0].0x0 since=199s v=(0 0)
00010000:00010000:2.0:1782361985.860865:0:6591:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.860873:0:6591:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860889:0:6591:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 20 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.860899:0:6591:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 20 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.860907:0:6591:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992379392:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.860945:0:6591:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d4d80 going to sleep for 11 seconds
00010000:00010000:0.0:1782361985.861021:0:14579:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005b635ae2/0x57e58d5a90c7b9ef lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2231 expref: 25 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.861033:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379264:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.861057:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861070:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861076:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861084:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861091:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861119:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.861141:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.861148:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.861157:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2a00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.861160:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.861168:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.861180:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.861186:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e27e998e/0x57e58d5a90c7edd5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d0:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.861206:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.861214:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.861216:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.861218:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861231:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 24 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861238:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1cf:0x0].0x0 since=198s v=(0 0)
00010000:00010000:0.0:1782361985.861241:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.861245:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861264:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 24 pid: 14578 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.861274:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 24 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.861284:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379520:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.861322:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00000100:00100000:1.0:1782361985.862541:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.862545:0:6591:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6591:1868940992379392:192.168.202.24@tcp:104:
00010000:00010000:2.0:1782361985.862564:0:6591:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.862587:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137280
00000100:00100000:3.0:1782361985.862594:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137280
00010000:00010000:3.0:1782361985.862654:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 21 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.862686:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 255
00000100:00100000:3.0:1782361985.862750:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+21:2365:x1868940985137280:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361985.862762:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361985.862768:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 21 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.862779:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 21 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.862808:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a372d61a/0x57e58d5a90c7b7f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2174 expref: 21 pid: 14579 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.862880:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379520:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.862896:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.862900:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.862901:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:3.0:1782361985.862911:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.862927:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.862957:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:2.0:1782361985.862981:0:6591:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.862992:0:6591:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.862997:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985137280:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 301us (456us total) trans 0 rc 0/0
00010000:00010000:2.0:1782361985.863010:0:6591:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.863013:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 255
00010000:00010000:2.0:1782361985.863024:0:6591:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.863057:0:6591:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00002000:00080000:2.0:1782361985.863183:0:6591:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:458
00010000:00010000:1.0:1782361985.863244:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00000100:00100000:2.0:1782361985.863248:0:6591:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5047f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:35001:x1868940992354176:12345-0@lo:5:osp-pre-1-0.0 Request processed in 291207us (291326us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.863251:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.863262:0:6591:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500
00010000:00010000:1.0:1782361985.863266:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79600 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.863271:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863280:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863292:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863299:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd00a568/0x57e58d5a90c7eddc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6591 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863312:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.863313:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.863314:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361985.863390:0:35001:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5047f7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35001:1868940992354176:0@lo:5:osp-pre-1-0.0
00000100:00100000:1.0:1782361985.863400:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000004:00080000:3.0:1782361985.863402:0:35001:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x241:0x0] from OST, last_created [0x280000400:0x241:0x0]last_used is [0x280000400:0x1ca:0x0]
00000100:00100000:1.0:1782361985.863460:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:3.0:1782361985.863468:0:35001:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35001:1868940992379776:0@lo:5:osp-pre-1-0.0
00000100:00100000:2.0:1782361985.863469:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137408
00000100:00100000:1.0:1782361985.863474:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1868940992379648:0@lo:13:osp-pre-1-0.0
00000100:00100000:2.0:1782361985.863476:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137408
00010000:00010000:2.0:1782361985.863501:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 25 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.863510:0:35001:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361985.863519:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1782361985.863536:0:35001:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e52b71b240 going to sleep for 11 seconds
00000100:00100000:2.0:1782361985.863536:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 256
00000100:00100000:0.0:1782361985.863547:0:6589:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992379776
00000100:00100000:2.0:1782361985.863549:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+25:2364:x1868940985137408:12345-192.168.202.24@tcp:103:ldlm_bl.0
00000100:00100000:0.0:1782361985.863553:0:6589:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992379776
00010000:00010000:2.0:1782361985.863561:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.863568:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 25 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.863580:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 25 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.863590:0:6589:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501
00010000:00010000:2.0:1782361985.863597:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040165550/0x57e58d5a90c7b97f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2207 expref: 25 pid: 14578 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.863602:0:6589:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:35001:x1868940992379776:12345-0@lo:5:osp-pre-1-0.0
00010000:00010000:2.0:1782361985.863615:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.863620:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cf:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.863624:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.863638:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:0.0:1782361985.863639:0:6589:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 578
00010000:00010000:2.0:1782361985.863668:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.863686:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.863704:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+24:2364:x1868940985137408:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 158us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.863720:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 256
00010000:00010000:1.0:1782361985.863723:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863735:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863744:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.863753:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992379648
00010000:00010000:1.0:1782361985.863758:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00000100:00100000:2.0:1782361985.863759:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992379648
00000100:00100000:2.0:1782361985.863802:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 215
00000100:00100000:2.0:1782361985.863812:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868940992379648:12345-0@lo:13:osp-pre-1-0.0
00002000:00000024:2.0:1782361985.863853:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 229441536 pending 131072 free 3859808256 avail 3857711104
00000100:00100000:2.0:1782361985.863898:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074da300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3308:x1868940992379648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (381us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361985.863906:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 215
00000100:00100000:2.0:1782361985.863954:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1868940992379648:0@lo:13:osp-pre-1-0.0
00010000:00010000:1.0:1782361985.863975:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863990:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 23 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.863998:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1ce:0x0].0x0 since=198s v=(0 0)
00010000:00010000:1.0:1782361985.864002:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.864006:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.864032:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 23 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.864046:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 23 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.864048:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.864065:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.864070:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379904:192.168.202.24@tcp:104:
00010000:00010000:3.0:1782361985.864081:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.864085:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.864104:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.864119:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.864121:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e509372900 going to sleep for 11 seconds
00010000:00010000:3.0:1782361985.864131:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000087b9f376/0x57e58d5a90c7ede3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.864148:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.864151:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.864152:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.865763:0:6589:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:35001:x1868940992379776:12345-0@lo:5:osp-pre-1-0.0 Request processed in 2165us (2254us total) trans 4294967448 rc 0/0
00000100:00100000:0.0:1782361985.865769:0:6589:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501
00000100:00100000:3.0:1782361985.865811:0:35001:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602c380 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:35001:1868940992379776:0@lo:5:osp-pre-1-0.0
00000004:00080000:3.0:1782361985.865820:0:35001:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x241:0x0]-[0x280000400:0x261:0x0]
00000100:00100000:1.0:1782361985.866777:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992379904:192.168.202.24@tcp:104:
00010000:00010000:1.0:1782361985.866805:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.867976:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.868041:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137536
00000100:00100000:2.0:1782361985.868048:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137536
00010000:00010000:2.0:1782361985.868075:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 24 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.868116:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 257
00000100:00100000:2.0:1782361985.868125:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518629850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+24:2365:x1868940985137536:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.868139:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.868152:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 24 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.868164:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 24 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.868183:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003ff5a7c9/0x57e58d5a90c7b90f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21dd expref: 24 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.868195:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.868199:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1ce:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.868204:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.868213:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.868242:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.868263:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868275:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.868286:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518629850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+23:2365:x1868940985137536:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 160us (310us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.868288:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.868300:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 257
00010000:00010000:1.0:1782361985.868304:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868326:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.868348:0:5778:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.868354:0:5778:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.868362:0:5778:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.868372:0:5778:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.868380:0:5778:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.868392:0:5778:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.868399:0:5778:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002fd76080/0x57e58d5a90c7edea lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1ce:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.868431:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.868434:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.868437:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.868464:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868478:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 22 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868492:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1cd:0x0].0x0 since=199s v=(0 0)
00010000:00010000:1.0:1782361985.868496:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.868501:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868527:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 22 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.868540:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 22 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.868553:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380032:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.868599:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5093726c0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.869589:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380032:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.869609:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.870152:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361985.870184:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137664
00000100:00100000:0.0:1782361985.870189:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137664
00010000:00010000:0.0:1782361985.870207:0:8302:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 23 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.870236:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 258
00000100:00100000:0.0:1782361985.870245:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+23:2365:x1868940985137664:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:0.0:1782361985.870255:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:0.0:1782361985.870262:0:8302:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 23 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870274:0:8302:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 23 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870290:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007b910f3/0x57e58d5a90c7b89f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb21b3 expref: 23 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870313:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.870316:0:8302:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cd:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.870320:0:8302:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870325:0:8302:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870346:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.870371:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.870372:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+22:2365:x1868940985137664:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 129us (222us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.870383:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 258
00010000:00010000:1.0:1782361985.870391:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870453:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870461:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870489:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:0.0:1782361985.870513:0:5779:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:0.0:1782361985.870520:0:5779:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870533:0:5779:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620e00 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:0.0:1782361985.870538:0:5779:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870547:0:5779:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870557:0:5779:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870570:0:5779:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f5295343/0x57e58d5a90c7edf1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.870581:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.870582:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.870584:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.870632:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870651:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 21 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870659:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1cc:0x0].0x0 since=199s v=(0 0)
00010000:00010000:1.0:1782361985.870662:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:1.0:1782361985.870666:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870688:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 21 pid: 6589 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.870699:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 21 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361985.870708:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380160:192.168.202.24@tcp:104:
00000100:00100000:1.0:1782361985.870746:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e509372900 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.872799:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361985.872814:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e4074db480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380160:192.168.202.24@tcp:104:
00000100:00100000:2.0:1782361985.872866:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137792
00000100:00100000:2.0:1782361985.872873:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137792
00010000:00010000:1.0:1782361985.872880:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.872899:0:5777:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 22 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.872946:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 259
00000100:00100000:2.0:1782361985.872953:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+22:2365:x1868940985137792:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.872966:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.872970:0:5777:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 22 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.872978:0:5777:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 22 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.872990:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000066a9d799/0x57e58d5a90c7b82f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb2189 expref: 22 pid: 6589 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.872999:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.873003:0:5777:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cc:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.873007:0:5777:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.873016:0:5777:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.873038:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:1.0:1782361985.873066:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.873075:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+21:2365:x1868940985137792:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 119us (289us total) trans 0 rc 0/0
00010000:00010000:1.0:1782361985.873083:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.873098:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 259
00010000:00010000:1.0:1782361985.873099:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873108:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873124:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:1.0:1782361985.873136:0:17392:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:1.0:1782361985.873141:0:17392:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873148:0:17392:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505620800 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:1.0:1782361985.873152:0:17392:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873160:0:17392:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873172:0:17392:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873186:0:17392:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a2c3e8ed/0x57e58d5a90c7edf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361985.873203:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.873206:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:1.0:1782361985.873207:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361985.873311:0:14579:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.873322:0:14579:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 20 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.873326:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x1cb:0x0].0x0 since=199s v=(0 0)
00010000:00010000:0.0:1782361985.873328:0:14579:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:0.0:1782361985.873331:0:14579:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 4/0,1 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.873352:0:14579:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 20 pid: 34033 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.873365:0:14579:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 20 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:0.0:1782361985.873377:0:14579:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380288:192.168.202.24@tcp:104:
00000100:00100000:0.0:1782361985.873471:0:14579:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e5181fe6c0 going to sleep for 11 seconds
00000100:00100000:0.0:1782361985.874306:0:14579:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_005:lustre-OST0000_UUID:14579:1868940992380288:192.168.202.24@tcp:104:
00010000:00010000:0.0:1782361985.874327:0:14579:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:3.0:1782361985.874677:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361985.874719:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985137920
00000100:00100000:2.0:1782361985.874724:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985137920
00010000:00010000:2.0:1782361985.874744:0:5776:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 21 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.874784:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 260
00000100:00100000:2.0:1782361985.874804:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+21:2364:x1868940985137920:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361985.874813:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361985.874816:0:5776:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 21 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.874824:0:5776:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 21 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.874856:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005c986fc8/0x57e58d5a90c7b7bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400010020 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb215f expref: 21 pid: 34033 timeout: 1154 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.874869:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.874873:0:5776:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1cb:0x0].0x0 since=0s v=(1 0)
00010000:00010000:2.0:1782361985.874877:0:5776:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.874886:0:5776:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361985.874907:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00010000:0.0:1782361985.874929:0:14579:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.874939:0:14579:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.874946:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985137920:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 141us (267us total) trans 0 rc 0/0
00010000:00010000:0.0:1782361985.874952:0:14579:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361985.874958:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 260
00010000:00010000:0.0:1782361985.874964:0:14579:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361985.874984:0:14579:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool
00010000:00010000:3.0:1782361985.875020:0:8301:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp.  (0 blwis in pool)
00010000:00010000:3.0:1782361985.875028:0:8301:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.875038:0:8301:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2000 already unused, calling callback (ffffffffc16b0e90)
00010000:00010000:3.0:1782361985.875042:0:8301:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.875064:0:8301:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.875079:0:8301:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00002000:00080000:0.0:1782361985.875081:0:14579:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:458
00010000:00010000:3.0:1782361985.875091:0:8301:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000009e31fd8/0x57e58d5a90c7edff lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1cb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14579 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361985.875113:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.875116:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361985.875118:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361985.875140:0:14579:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5102da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_005:lustre-MDT0000-mdtlov_UUID+5:34998:x1868940992354048:12345-0@lo:5:osp-pre-0-0.0 Request processed in 303118us (303251us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.875149:0:14579:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 499
00000100:00100000:2.0:1782361985.875176:0:34998:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e5102d9500 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34998:1868940992354048:0@lo:5:osp-pre-0-0.0
00000004:00080000:2.0:1782361985.875196:0:34998:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x241:0x0] from OST, last_created [0x240000400:0x241:0x0]last_used is [0x240000400:0x1ca:0x0]
00000100:00100000:2.0:1782361985.875253:0:34998:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34998:1868940992380544:0@lo:5:osp-pre-0-0.0
00000100:00100000:0.0:1782361985.875256:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52e3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992380416:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1782361985.875293:0:34998:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1782361985.875299:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1782361985.875320:0:34998:0:(client.c:2701:ptlrpc_set_wait()) set ffff95e4073d40c0 going to sleep for 11 seconds
00000100:00100000:3.0:1782361985.875322:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992380544
00000100:00100000:3.0:1782361985.875327:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992380544
00000100:00100000:0.0:1782361985.875343:0:6592:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992380416
00000100:00100000:0.0:1782361985.875349:0:6592:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992380416
00000100:00100000:2.0:1782361985.875365:0:14578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 502
00000100:00100000:2.0:1782361985.875375:0:14578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:34998:x1868940992380544:12345-0@lo:5:osp-pre-0-0.0
00000100:00100000:0.0:1782361985.875383:0:6592:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 216
00000100:00100000:0.0:1782361985.875394:0:6592:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868940992380416:12345-0@lo:13:osp-pre-0-0.0
00002000:00080000:2.0:1782361985.875408:0:14578:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 578
00002000:00000024:0.0:1782361985.875414:0:6592:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 229703680 pending 131072 free 3859808256 avail 3857711104
00000100:00100000:0.0:1782361985.875476:0:6592:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3306:x1868940992380416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 83us (177us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361985.875484:0:6592:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 216
00000100:00100000:3.0:1782361985.875550:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992380416:0@lo:13:osp-pre-0-0.0
00000100:00100000:2.0:1782361985.877422:0:14578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:34998:x1868940992380544:12345-0@lo:5:osp-pre-0-0.0 Request processed in 2049us (2130us total) trans 8589934741 rc 0/0
00000100:00100000:2.0:1782361985.877429:0:14578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 502
00000100:00100000:3.0:1782361985.877460:0:34998:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52e3c8380 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:34998:1868940992380544:0@lo:5:osp-pre-0-0.0
00000004:00080000:3.0:1782361985.877472:0:34998:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x241:0x0]-[0x240000400:0x261:0x0]
00010000:00010000:0.0:1782361986.607186:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:0.0:1782361987.630997:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361988.207059:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992381056:0@lo:400:kworker.0
00000100:00100000:0.0:1782361988.207059:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd:3307:1868940992380672:0@lo:400:kworker.0
00000100:00100000:2.0:1782361988.207062:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1868940992380800:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207078:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e53602e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1868940992380928:0@lo:400:kworker.0
00000100:00100000:2.0:1782361988.207156:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361988.207158:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1782361988.207159:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1782361988.207202:0:10734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381056
00000100:00100000:3.0:1782361988.207209:0:10734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381056
00000100:00100000:2.0:1782361988.207244:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e505627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868940992381312:0@lo:400:kworker.0
00000100:00100000:0.0:1782361988.207251:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e505624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1868940992381184:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207271:0:10734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 496
00000100:00100000:1.0:1782361988.207274:0:34970:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992380672
00000100:00100000:1.0:1782361988.207280:0:34970:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992380672
00000100:00100000:3.0:1782361988.207285:0:10734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1868940992381056:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361988.207288:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1782361988.207293:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361988.207320:0:34970:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128
00000100:00100000:1.0:1782361988.207330:0:34970:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd+19:3307:x1868940992380672:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1782361988.207343:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992380800
00000100:00100000:3.0:1782361988.207348:0:10734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074db480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3306:x1868940992381056:12345-0@lo:400:kworker.0 Request processed in 67us (195us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361988.207349:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992380800
00000100:00100000:2.0:1782361988.207357:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1782361988.207379:0:10734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 496
00000100:00100000:0.0:1782361988.207386:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381312
00000100:00100000:1.0:1782361988.207390:0:34970:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fa050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd+19:3307:x1868940992380672:12345-0@lo:400:kworker.0 Request processed in 60us (233us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361988.207391:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381312
00000100:00100000:3.0:1782361988.207397:0:10734:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381184
00000100:00100000:3.0:1782361988.207403:0:10734:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381184
00000100:00100000:1.0:1782361988.207403:0:34970:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128
00000100:00080000:2.0:1782361988.207416:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:0.0:1782361988.207423:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992380928
00000100:00080000:2.0:1782361988.207425:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1782361988.207428:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992380928
00000100:00080000:2.0:1782361988.207430:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00080000:2.0:1782361988.207453:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:3.0:1782361988.207459:0:10734:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 497
00000100:00100000:1.0:1782361988.207465:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd:3307:1868940992380672:0@lo:400:kworker.0
00000100:00100000:0.0:1782361988.207465:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102
00000100:00100000:3.0:1782361988.207470:0:10734:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1868940992381184:12345-0@lo:400:kworker.0
00000100:00100000:0.0:1782361988.207480:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868940992380800:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361988.207496:0:34999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103
00000100:00100000:3.0:1782361988.207505:0:10734:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3307:x1868940992381184:12345-0@lo:400:kworker.0 Request processed in 40us (214us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361988.207512:0:34999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868940992381312:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1782361988.207512:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e505624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1868940992381184:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207514:0:10734:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 497
00000100:00100000:0.0:1782361988.207543:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868940992380800:12345-0@lo:400:kworker.0 Request processed in 66us (390us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361988.207551:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104
00000100:00100000:0.0:1782361988.207558:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102
00000100:00100000:1.0:1782361988.207562:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992381056:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207564:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868940992380928:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361988.207568:0:34999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868940992381312:12345-0@lo:400:kworker.0 Request processed in 61us (283us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361988.207578:0:34999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103
00000100:00100000:0.0:1782361988.207606:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1868940992380800:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207621:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1868940992380928:12345-0@lo:400:kworker.0 Request processed in 61us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361988.207627:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e505627800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868940992381312:0@lo:400:kworker.0
00000100:00100000:3.0:1782361988.207632:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104
00000100:00100000:3.0:1782361988.207668:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e53602e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3309:1868940992380928:0@lo:400:kworker.0
00010000:00010000:1.0:1782361988.655029:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00010000:3.0:1782361989.679025:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:3.0:1782361990.170204:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361990.170240:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361990.170270:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940984910336
00000100:00100000:2.0:1782361990.170280:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940984910336
00000100:00100000:3.0:1782361990.170315:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361990.170334:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 17
00000100:00100000:2.0:1782361990.170343:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405611c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0+-99:2361:x1868940984910336:12345-192.168.202.24@tcp:35:bash.0
00000020:00080000:2.0:1782361990.170352:0:34978:0:(tgt_handler.c:807:tgt_request_handle()) operation 35 on unconnected OST from 12345-192.168.202.24@tcp
00000100:00100000:3.0:1782361990.170361:0:14579:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138304
00000100:00100000:3.0:1782361990.170366:0:14579:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138304
00000100:00080000:1.0:1782361990.170412:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1782361990.170420:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405611c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:0+-99:2361:x1868940984910336:12345-192.168.202.24@tcp:35:bash.0 Request processed in 75us (222us total) trans 0 rc -107/-107
00000100:00100000:2.0:1782361990.170430:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 17
00000100:00100000:3.0:1782361990.170440:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 498
00000100:00100000:3.0:1782361990.171107:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e505626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985138304:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:3.0:1782361990.171156:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e505626300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985138304:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 707us (841us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361990.171163:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 498
00000100:00100000:0.0:1782361990.172645:0:34971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138048
00000100:00100000:0.0:1782361990.172654:0:34971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138048
00000100:00100000:0.0:1782361990.172779:0:34971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 129
00000100:00100000:0.0:1782361990.172795:0:34971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:000ace06-2339-4888-a9a0-3d996f881553+10:2365:x1868940985138048:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:0.0:1782361990.172855:0:34971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:000ace06-2339-4888-a9a0-3d996f881553+10:2365:x1868940985138048:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 57us (2610us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361990.172863:0:34971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 129
00000100:00100000:1.0:1782361990.177316:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361990.177454:0:14578:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138176
00000100:00100000:2.0:1782361990.177463:0:14578:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138176
00000100:00100000:2.0:1782361990.177571:0:14578:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 499
00000100:00100000:2.0:1782361990.177587:0:14578:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985138176:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:2.0:1782361990.177657:0:14578:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985138176:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 73us (348us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361990.177665:0:14578:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 499
00000100:00080000:1.0:1782361990.177767:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:3.0:1782361990.186182:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361990.186239:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138432
00000100:00100000:0.0:1782361990.186248:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138432
00000100:00100000:0.0:1782361990.186299:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28
00000100:00100000:0.0:1782361990.186308:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e505627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2361:x1868940985138432:12345-192.168.202.24@tcp:38:ptlrpcd_rcv.0
00010000:00080000:0.0:1782361990.186336:0:34977:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp t64424509476 exp 0000000000000000 cur 1059 last 0
00000020:00000080:0.0:1782361990.186384:0:34977:0:(genops.c:1406:class_connect()) connect: client f4cf112e-56b0-4499-aacf-a956cfcc6c06, cookie 0x57e58d5a90c7ee06
00000004:00100000:0.0:1782361990.186460:0:34977:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli <unknown> supports cksum type f7, return f7
00000001:00000004:0.0:1782361990.186466:0:34977:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 16, last_transno is 68719476736
00000100:00080000:1.0:1782361990.206111:0:34977:0:(import.c:65:import_set_state_nolock()) ffff95e5181a6800 : changing import state from RECOVER to FULL
00000100:00100000:1.0:1782361990.206197:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e505627800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+6:2361:x1868940985138432:12345-192.168.202.24@tcp:38:ptlrpcd_rcv.0 Request processed in 19886us (20021us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361990.206220:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28
00000001:00080000:2.0:1782361990.287660:0:7494:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967448 is committed
00010000:00010000:1.0:1782361990.702939:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:00080000:2.0:1782361990.792043:0:13711:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934741 is committed
00000100:00100000:0.0:1782361991.278946:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:0.0:1782361991.278968:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1868940992381568:0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1782361991.278979:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e505624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992381440:0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1782361991.279043:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1782361991.279086:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:3.0:1782361991.279100:0:14033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381440
00000100:00100000:3.0:1782361991.279120:0:14033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381440
00000100:00100000:0.0:1782361991.279143:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381568
00000100:00100000:0.0:1782361991.279148:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381568
00000100:00080000:1.0:1782361991.279160:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:1.0:1782361991.279167:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1782361991.279176:0:14033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 217
00000100:00100000:0.0:1782361991.279185:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 218
00000100:00100000:3.0:1782361991.279190:0:14033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868940992381440:12345-0@lo:13:osp-pre-0-0.0
00000100:00100000:1.0:1782361991.279191:0:6592:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 3 min 2 max 16
00000100:00100000:0.0:1782361991.279199:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868940992381568:12345-0@lo:13:osp-pre-1-0.0
00000100:00100000:1.0:1782361991.279203:0:6592:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_003'
00002000:00000024:0.0:1782361991.279231:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 229310464 pending 0 free 3859808256 avail 3857711104
00002000:00000024:3.0:1782361991.279232:0:14033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 229572608 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1782361991.279285:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52dc84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3308:x1868940992381568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (200us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361991.279293:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 218
00000100:00100000:3.0:1782361991.279294:0:14033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3306:x1868940992381440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (250us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361991.279304:0:14033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 217
00000100:00100000:0.0:1782361991.279333:0:3308:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967448 gen 2
00000100:00100000:0.0:1782361991.279356:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3308:1868940992381568:0@lo:13:osp-pre-1-0.0
00000100:00100000:3.0:1782361991.279358:0:3306:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934741 gen 2
00000100:00100000:3.0:1782361991.279376:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e505624a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992381440:0@lo:13:osp-pre-0-0.0
00010000:00010000:1.0:1782361991.726924:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:02000400:3.0:1782361992.481122:0:35656:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg224-client.virtnet: executing wait_import_state_mount (FULL|IDLE) mdc.lustre-MDT0000-mdc-*.mds_server_uuid
00010000:00010000:1.0:1782361992.751898:0:17392:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000001:02000400:2.0:1782361993.162289:0:35706:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: mdc.lustre-MDT0000-mdc-*.mds_server_uuid in FULL state after 0 sec
00000100:00100000:3.0:1782361993.327054:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd:3307:1868940992381696:0@lo:400:kworker.0
00000100:00100000:3.0:1782361993.327123:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361993.327150:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1868940992381824:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.327190:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361993.327264:0:3308:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:2.0:1782361993.327270:0:34969:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381696
00000100:00100000:1.0:1782361993.327270:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1868940992381952:0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327279:0:34969:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381696
00000100:00100000:1.0:1782361993.327294:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361993.327328:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381824
00000100:00100000:1.0:1782361993.327332:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381824
00000100:00100000:2.0:1782361993.327336:0:34969:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130
00000100:00100000:2.0:1782361993.327348:0:34969:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd+19:3307:x1868940992381696:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.327373:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992381952
00000100:00100000:1.0:1782361993.327377:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992381952
00000100:00100000:1.0:1782361993.327403:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105
00000100:00100000:1.0:1782361993.327412:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868940992381824:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327430:0:34969:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064f8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd+19:3307:x1868940992381696:12345-0@lo:400:kworker.0 Request processed in 76us (299us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361993.327439:0:34969:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130
00000100:00100000:1.0:1782361993.327454:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3308:x1868940992381824:12345-0@lo:400:kworker.0 Request processed in 43us (263us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361993.327462:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105
00000100:00100000:1.0:1782361993.327480:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106
00000100:00100000:1.0:1782361993.327488:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868940992381952:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327519:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:a9f0a09a-7229-472e-a4ed-4bf5b46dabcd:3307:1868940992381696:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.327530:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3308:x1868940992381952:12345-0@lo:400:kworker.0 Request processed in 43us (233us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361993.327546:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106
00000100:00080000:1.0:1782361993.327565:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:2.0:1782361993.327636:0:3307:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1868940992382208:0@lo:400:kworker.0
00000100:00100000:0.0:1782361993.327643:0:3306:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992382080:0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327660:0:3307:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:0.0:1782361993.327683:0:3306:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:1.0:1782361993.327771:0:3308:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868940992382336:0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327773:0:34033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992382208
00000100:00100000:2.0:1782361993.327779:0:34033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992382208
00000100:00100000:1.0:1782361993.327806:0:3308:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo)
00000100:00100000:2.0:1782361993.327825:0:34033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992382080
00000100:00100000:2.0:1782361993.327847:0:34033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992382080
00000100:00100000:2.0:1782361993.327874:0:34033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 500
00000100:00100000:2.0:1782361993.327881:0:34033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3307:x1868940992382208:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327917:0:34033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52e3c9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3307:x1868940992382208:12345-0@lo:400:kworker.0 Request processed in 37us (256us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361993.327923:0:34033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 500
00000100:00100000:2.0:1782361993.327935:0:34033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 501
00000100:00100000:2.0:1782361993.327939:0:34033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3306:x1868940992382080:12345-0@lo:400:kworker.0
00000100:00100000:2.0:1782361993.327984:0:34033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52cb8aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_006:lustre-MDT0000-mdtlov_UUID+5:3306:x1868940992382080:12345-0@lo:400:kworker.0 Request processed in 44us (303us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361993.327991:0:34033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 501
00000100:00080000:2.0:1782361993.328016:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00080000:2.0:1782361993.328019:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:2.0:1782361993.328037:0:3307:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc84a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3307:1868940992382208:0@lo:400:kworker.0
00000100:00100000:0.0:1782361993.329089:0:3306:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3306:1868940992382080:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.329130:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940992382336
00000100:00100000:1.0:1782361993.329136:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940992382336
00000100:00100000:3.0:1782361993.329160:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc86d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3308:1868940992381952:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.329167:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107
00000100:00100000:3.0:1782361993.329178:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3308:1868940992381824:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.329178:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868940992382336:12345-0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.329218:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3308:x1868940992382336:12345-0@lo:400:kworker.0 Request processed in 45us (1415us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361993.329222:0:3308:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff95e52dc85180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3308:1868940992382336:0@lo:400:kworker.0
00000100:00100000:1.0:1782361993.329227:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107
00010000:00010000:3.0:1782361993.775043:0:8301:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:0.0:1782361994.550869:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.550920:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138560
00000100:00100000:1.0:1782361994.550931:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138560
00000100:00080000:2.0:1782361994.550996:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000
00000100:00100000:1.0:1782361994.551003:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29
00000100:00100000:1.0:1782361994.551015:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+6:30970:x1868940985138560:12345-192.168.202.24@tcp:101:lfs.0
00010000:00010000:1.0:1782361994.551035:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1782361994.551057:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621a00/0x57e58d5a90c7ee0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3206 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551112:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621400/0x57e58d5a90c7ee14 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551125:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621400/0x57e58d5a90c7ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551138:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621400/0x57e58d5a90c7ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1782361994.551374:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 8704
00000004:00200000:1.0:1782361994.551377:0:34976:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 32 stripe count 1 MDT count 1
00000004:00010000:1.0:1782361994.551472:0:34976:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621400/0x57e58d5a90c7ee14 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551491:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621a00/0x57e58d5a90c7ee0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3206 expref: 8 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551504:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621400/0x57e58d5a90c7ee14 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3206 expref: 7 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.551510:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:1.0:1782361994.551512:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00010000:1.0:1782361994.551515:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e505621400, rc 0)
00000100:00100000:1.0:1782361994.551557:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+7:30970:x1868940985138560:12345-192.168.202.24@tcp:101:lfs.0 Request processed in 547us (698us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361994.551562:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29
00000100:00100000:3.0:1782361994.555502:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.555562:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138688
00000100:00100000:2.0:1782361994.555571:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138688
00000100:00100000:2.0:1782361994.555623:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30
00000100:00100000:2.0:1782361994.555634:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e505624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+7:30970:x1868940985138688:12345-192.168.202.24@tcp:41:lfs.0
00000004:00000024:2.0:1782361994.555686:0:35402:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 2097152 pending 0 free 2261647360 avail 2259550208
00000100:00100000:2.0:1782361994.555772:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e505624a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+7:30970:x1868940985138688:12345-192.168.202.24@tcp:41:lfs.0 Request processed in 139us (277us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361994.555793:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30
00000100:00100000:3.0:1782361994.558017:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.558188:0:6593:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138816
00000100:00100000:0.0:1782361994.558196:0:6593:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138816
00000100:00080000:2.0:1782361994.558258:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000
00000100:00100000:0.0:1782361994.558264:0:6593:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 219
00000100:00100000:0.0:1782361994.558276:0:6593:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:30970:x1868940985138816:12345-192.168.202.24@tcp:13:lfs.0
00002000:00000024:0.0:1782361994.558309:0:6593:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 13631488 granted 229572608 pending 0 free 3859808256 avail 3857711104
00000100:00100000:0.0:1782361994.558363:0:6593:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518357100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:30970:x1868940985138816:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 89us (351us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361994.558370:0:6593:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 219
00000100:00100000:0.0:1782361994.559555:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361994.559599:0:14033:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985138944
00000100:00100000:3.0:1782361994.559604:0:14033:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985138944
00000100:00080000:2.0:1782361994.559651:0:5786:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001
00000100:00100000:3.0:1782361994.559653:0:14033:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 220
00000100:00100000:3.0:1782361994.559665:0:14033:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:30970:x1868940985138944:12345-192.168.202.24@tcp:13:lfs.0
00002000:00000024:3.0:1782361994.559700:0:14033:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 8519680 granted 229310464 pending 0 free 3859808256 avail 3857711104
00000100:00100000:3.0:1782361994.559752:0:14033:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:30970:x1868940985138944:12345-192.168.202.24@tcp:13:lfs.0 Request processed in 91us (198us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361994.559759:0:14033:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 220
00000100:00100000:3.0:1782361994.579819:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.579906:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985139200
00000100:00100000:2.0:1782361994.579916:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985139200
00000100:00100000:2.0:1782361994.579975:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31
00000100:00100000:2.0:1782361994.579984:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+7:30988:x1868940985139200:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.580002:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.580021:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee1b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb320d expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580092:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580102:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580110:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580119:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580123:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580127:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580526:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78e00/0x57e58d5a90c7ee30 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580537:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78e00/0x57e58d5a90c7ee30 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580542:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78e00/0x57e58d5a90c7ee30 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.580549:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2b:0x0]: returning size 6
00010000:00010000:2.0:1782361994.580667:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580673:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580680:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580686:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.580690:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580697:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580721:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.580725:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.580730:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580736:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580746:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580756:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580762:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580767:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.580769:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580775:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580783:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb4481dc5 (ffff95e408dadc00)
00010000:00010000:2.0:1782361994.580786:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.580789:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580795:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee29 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb4481dc5 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580896:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee1b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb320d expref: 10 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580908:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78e00/0x57e58d5a90c7ee30 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb320d expref: 9 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.580914:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2b:0x0].0x0 (ffff95e408dad200)
00010000:00010000:2.0:1782361994.580916:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.580924:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78e00, rc 0)
00000100:00100000:2.0:1782361994.580973:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518354380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+9:30988:x1868940985139200:12345-192.168.202.24@tcp:101:grep.0 Request processed in 989us (1162us total) trans 68719476737 rc 0/0
00000100:00100000:2.0:1782361994.580981:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31
00000100:00100000:0.0:1782361994.588820:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.588977:0:34479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985139328
00000100:00100000:2.0:1782361994.588987:0:34479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985139328
00002000:00100000:2.0:1782361994.589030:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c2:0x0] (0->4095)  req@ffff95e4075a4700 x1868940985139328/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.589040:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4075a4700 with x1868940985139328 ext(0->4095)
00002000:00010000:2.0:1782361994.589045:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e4075a4700
00000100:00100000:2.0:1782361994.589075:0:34479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 240
00000100:00100000:2.0:1782361994.589084:0:34479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2363:x1868940985139328:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.589330:0:34479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4075a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2363:x1868940985139328:12345-192.168.202.24@tcp:3:grep.0 Request processed in 246us (517us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.589338:0:34479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 240
00002000:00100000:2.0:1782361994.589345:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c2:0x0] (0->4095)  req@ffff95e4075a4700 x1868940985139328/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.589353:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4075a4700 with x1868940985139328 ext(0->4095)
00002000:00010000:2.0:1782361994.589357:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e4075a4700
00000100:00100000:0.0:1782361994.593008:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.593061:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985139584
00000100:00100000:2.0:1782361994.593070:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985139584
00000100:00100000:2.0:1782361994.593122:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 18
00000100:00100000:2.0:1782361994.593132:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+9:30988:x1868940985139584:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.593425:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+10:30988:x1868940985139584:12345-192.168.202.24@tcp:35:grep.0 Request processed in 293us (424us total) trans 68719476738 rc 0/0
00000100:00100000:2.0:1782361994.593447:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 18
00000100:00100000:3.0:1782361994.600479:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.600869:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985139840
00000100:00100000:1.0:1782361994.600879:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985139840
00000100:00100000:1.0:1782361994.600946:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32
00000100:00100000:1.0:1782361994.600958:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+10:30992:x1868940985139840:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:1.0:1782361994.600984:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:1.0:1782361994.601004:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621a00/0x57e58d5a90c7ee3e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3214 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601425:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601455:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601466:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601481:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601487:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.601493:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602461:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505620e00/0x57e58d5a90c7ee53 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602472:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505620e00/0x57e58d5a90c7ee53 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602481:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505620e00/0x57e58d5a90c7ee53 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:1.0:1782361994.602491:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2c:0x0]: returning size 6
00010000:00010000:1.0:1782361994.602577:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602585:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602593:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602606:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:1.0:1782361994.602611:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602619:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602631:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:1.0:1782361994.602634:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1782361994.602638:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602645:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621200/0x57e58d5a90c7ee45 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602660:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602666:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602671:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602676:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505621e00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:1.0:1782361994.602679:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602686:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602705:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1fefa0a6 (ffff95e408d27500)
00010000:00010000:1.0:1782361994.602723:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:1.0:1782361994.602727:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602734:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621e00/0x57e58d5a90c7ee4c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1fefa0a6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602781:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505621a00/0x57e58d5a90c7ee3e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3214 expref: 13 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602795:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505620e00/0x57e58d5a90c7ee53 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3214 expref: 12 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:1.0:1782361994.602803:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2c:0x0].0x0 (ffff95e408d27b00)
00010000:00010000:1.0:1782361994.602806:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:1.0:1782361994.602808:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e505620e00, rc 0)
00000100:00100000:1.0:1782361994.602911:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518354a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+12:30992:x1868940985139840:12345-192.168.202.24@tcp:101:grep.0 Request processed in 1955us (2440us total) trans 68719476739 rc 0/0
00000100:00100000:1.0:1782361994.602919:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32
00000100:00100000:0.0:1782361994.606276:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.606337:0:34480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985139968
00000100:00100000:2.0:1782361994.606345:0:34480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985139968
00002000:00100000:2.0:1782361994.606378:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c2:0x0] (0->4095)  req@ffff95e503ea4380 x1868940985139968/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.606385:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e503ea4380 with x1868940985139968 ext(0->4095)
00002000:00010000:2.0:1782361994.606390:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e503ea4380
00000100:00100000:2.0:1782361994.606416:0:34480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 241
00000100:00100000:2.0:1782361994.606422:0:34480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985139968:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.606677:0:34480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985139968:12345-192.168.202.24@tcp:3:grep.0 Request processed in 253us (409us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.606685:0:34480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 241
00002000:00100000:2.0:1782361994.606691:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c2:0x0] (0->4095)  req@ffff95e503ea4380 x1868940985139968/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.606700:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e503ea4380 with x1868940985139968 ext(0->4095)
00002000:00010000:2.0:1782361994.606703:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e503ea4380
00000100:00100000:0.0:1782361994.609559:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.609605:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985140224
00000100:00100000:2.0:1782361994.609612:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985140224
00000100:00100000:2.0:1782361994.609656:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 19
00000100:00100000:2.0:1782361994.609663:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+12:30992:x1868940985140224:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.609950:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+13:30992:x1868940985140224:12345-192.168.202.24@tcp:35:grep.0 Request processed in 286us (398us total) trans 68719476740 rc 0/0
00000100:00100000:2.0:1782361994.609957:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 19
00000100:00100000:3.0:1782361994.619024:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.619078:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985140480
00000100:00100000:2.0:1782361994.619100:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985140480
00000100:00100000:2.0:1782361994.619171:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33
00000100:00100000:2.0:1782361994.619183:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+13:30995:x1868940985140480:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.619207:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.619226:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee61 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb321b expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619293:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619306:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619316:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619328:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619335:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619341:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619659:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78000/0x57e58d5a90c7ee76 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2d:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619668:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78000/0x57e58d5a90c7ee76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619675:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78000/0x57e58d5a90c7ee76 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.619690:0:35402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2d:0x0]: returning size 6
00010000:00010000:2.0:1782361994.619781:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619789:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619795:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619801:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.619805:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619812:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619824:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.619846:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.619850:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619856:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee68 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619869:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619875:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619890:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619895:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.619898:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619903:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619910:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x684c3f1c (ffff95e408dadc00)
00010000:00010000:2.0:1782361994.619912:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.619914:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619920:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee6f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x684c3f1c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619966:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee61 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb321b expref: 16 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619979:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78000/0x57e58d5a90c7ee76 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2d:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb321b expref: 15 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.619986:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2d:0x0].0x0 (ffff95e408dade00)
00010000:00010000:2.0:1782361994.619988:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.619991:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78000, rc 0)
00000100:00100000:2.0:1782361994.620046:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518356d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+15:30995:x1868940985140480:12345-192.168.202.24@tcp:101:grep.0 Request processed in 866us (1031us total) trans 68719476741 rc 0/0
00000100:00100000:2.0:1782361994.620061:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33
00000100:00100000:0.0:1782361994.623054:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.623133:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985140608
00000100:00100000:1.0:1782361994.623143:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985140608
00002000:00100000:1.0:1782361994.623183:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c3:0x0] (0->4095)  req@ffff95e503ea4000 x1868940985140608/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.623195:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e503ea4000 with x1868940985140608 ext(0->4095)
00002000:00010000:1.0:1782361994.623201:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e503ea4000
00000100:00100000:1.0:1782361994.623236:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 242
00000100:00100000:1.0:1782361994.623260:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985140608:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:1.0:1782361994.623480:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985140608:12345-192.168.202.24@tcp:3:grep.0 Request processed in 221us (433us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1782361994.623489:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 242
00002000:00100000:1.0:1782361994.623496:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x1c3:0x0] (0->4095)  req@ffff95e503ea4000 x1868940985140608/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.623504:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e503ea4000 with x1868940985140608 ext(0->4095)
00002000:00010000:1.0:1782361994.623509:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e503ea4000
00000100:00100000:0.0:1782361994.626731:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.626785:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985140864
00000100:00100000:2.0:1782361994.626794:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985140864
00000100:00100000:2.0:1782361994.626879:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 20
00000100:00100000:2.0:1782361994.626890:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+15:30995:x1868940985140864:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.627254:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+16:30995:x1868940985140864:12345-192.168.202.24@tcp:35:grep.0 Request processed in 364us (543us total) trans 68719476742 rc 0/0
00000100:00100000:2.0:1782361994.627262:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 20
00000100:00100000:3.0:1782361994.634927:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.634985:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985141120
00000100:00100000:2.0:1782361994.634992:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985141120
00000100:00100000:2.0:1782361994.635037:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34
00000100:00100000:2.0:1782361994.635045:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+16:30999:x1868940985141120:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.635065:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.635081:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee84 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3222 expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635150:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635164:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635174:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635184:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635202:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635207:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635557:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79600/0x57e58d5a90c7ee99 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2e:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635564:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79600/0x57e58d5a90c7ee99 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635568:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79600/0x57e58d5a90c7ee99 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.635583:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2e:0x0]: returning size 6
00010000:00010000:2.0:1782361994.635679:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635688:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635695:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635701:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.635719:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635727:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635749:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.635752:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.635758:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635773:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ee8b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635786:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635792:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635797:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635801:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.635805:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635811:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635817:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2c06bb61 (ffff95e408dadc00)
00010000:00010000:2.0:1782361994.635819:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.635822:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635867:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ee92 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2c06bb61 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635927:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ee84 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3222 expref: 19 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635940:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79600/0x57e58d5a90c7ee99 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2e:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3222 expref: 18 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.635947:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2e:0x0].0x0 (ffff95e408dadb00)
00010000:00010000:2.0:1782361994.635950:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.635952:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c79600, rc 0)
00000100:00100000:2.0:1782361994.636007:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518355c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+18:30999:x1868940985141120:12345-192.168.202.24@tcp:101:grep.0 Request processed in 962us (1088us total) trans 68719476743 rc 0/0
00000100:00100000:2.0:1782361994.636015:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34
00000100:00100000:1.0:1782361994.644549:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.644595:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.644618:0:6599:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985141248
00000100:00100000:0.0:1782361994.644630:0:6599:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985141248
00000100:00100000:2.0:1782361994.644678:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985141376
00000100:00100000:2.0:1782361994.644683:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985141376
00002000:00100000:2.0:1782361994.644734:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c3:0x0] (0->4095)  req@ffff95e4074daa00 x1868940985141376/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.644743:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074daa00 with x1868940985141376 ext(0->4095)
00002000:00010000:2.0:1782361994.644749:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074daa00
00000100:00100000:2.0:1782361994.644783:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 243
00000100:00100000:2.0:1782361994.644793:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985141376:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:0.0:1782361994.644965:0:6599:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 2
00000100:00100000:0.0:1782361994.644973:0:6599:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+18:2365:x1868940985141248:12345-192.168.202.24@tcp:63:ll_sa.0
00010000:00010000:0.0:1782361994.645010:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.645028:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3400/0x57e58d5a90c7eea7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3229 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361994.645056:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985141376:12345-192.168.202.24@tcp:3:grep.0 Request processed in 263us (460us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.645065:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 243
00002000:00100000:2.0:1782361994.645072:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c3:0x0] (0->4095)  req@ffff95e4074daa00 x1868940985141376/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00010000:00010000:0.0:1782361994.645079:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645093:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00002000:00100000:2.0:1782361994.645095:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074daa00 with x1868940985141376 ext(0->4095)
00002000:00010000:2.0:1782361994.645103:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074daa00
00010000:00010000:0.0:1782361994.645109:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645132:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645140:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645148:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645479:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645486:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645491:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.645506:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2f:0x0]: returning size 6
00000004:00200000:0.0:1782361994.645509:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.645526:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645542:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645551:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645557:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645564:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645570:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2600 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.645574:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645581:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645592:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.645595:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.645599:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645605:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2600/0x57e58d5a90c7eeae lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645618:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645624:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645635:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645655:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.645659:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645665:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645674:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68e42da7 (ffff95e5044f6c00)
00010000:00010000:0.0:1782361994.645677:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.645680:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645685:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2c00/0x57e58d5a90c7eeb5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645722:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3400/0x57e58d5a90c7eea7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3229 expref: 20 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645739:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3000/0x57e58d5a90c7eebc lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3229 expref: 19 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645746:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff95e5044f6a00)
00010000:00010000:0.0:1782361994.645748:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.645751:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4062e3000, rc 0)
00010000:00010000:0.0:1782361994.645755:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.645763:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3c00/0x57e58d5a90c7eec3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3230 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645793:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645801:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645808:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645819:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645825:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.645849:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646073:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646082:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646090:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.646104:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x30:0x0]: returning size 6
00000004:00200000:0.0:1782361994.646107:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.646116:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646135:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646142:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646149:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646155:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646160:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2000 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.646163:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646169:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646177:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.646179:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.646182:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646188:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2000/0x57e58d5a90c7eeca lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646197:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646203:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646215:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646221:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.646223:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646230:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646236:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7d261ae4 (ffff95e5044f6300)
00010000:00010000:0.0:1782361994.646237:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.646239:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646242:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2800/0x57e58d5a90c7eed1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646261:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3c00/0x57e58d5a90c7eec3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3230 expref: 21 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646271:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3800/0x57e58d5a90c7eed8 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3230 expref: 20 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646277:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff95e5044f6e00)
00010000:00010000:0.0:1782361994.646279:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.646281:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4062e3800, rc 0)
00010000:00010000:0.0:1782361994.646285:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.646292:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2a00/0x57e58d5a90c7eedf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3237 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646320:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646328:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646335:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646347:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646354:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646360:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646533:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646542:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646549:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.646561:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x31:0x0]: returning size 6
00000004:00200000:0.0:1782361994.646564:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.646572:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646588:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646595:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646600:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646606:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646611:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3e00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.646614:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646620:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646628:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.646630:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.646633:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646638:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3e00/0x57e58d5a90c7eee6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646646:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646653:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646664:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646669:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e3a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.646672:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646678:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646686:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x223991a9 (ffff95e5044f6000)
00010000:00010000:0.0:1782361994.646689:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.646691:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646697:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3a00/0x57e58d5a90c7eeed lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646728:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2a00/0x57e58d5a90c7eedf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3237 expref: 22 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646740:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2200/0x57e58d5a90c7eef4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3237 expref: 21 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646747:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff95e5044f6500)
00010000:00010000:0.0:1782361994.646749:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.646751:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4062e2200, rc 0)
00010000:00010000:0.0:1782361994.646754:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.646761:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3200/0x57e58d5a90c7eefb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb323e expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646787:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646794:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646801:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646812:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646819:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.646825:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647026:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647035:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647042:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.647054:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x32:0x0]: returning size 6
00000004:00200000:0.0:1782361994.647057:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.647065:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647082:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647089:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647095:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647100:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647105:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2e00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.647108:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647113:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647121:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.647124:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.647126:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647132:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2e00/0x57e58d5a90c7ef02 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647140:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647146:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647157:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647161:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4062e2400 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.647164:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647170:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647177:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1133e6 (ffff95e5044f6100)
00010000:00010000:0.0:1782361994.647180:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.647182:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647188:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e2400/0x57e58d5a90c7ef09 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647206:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3200/0x57e58d5a90c7eefb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb323e expref: 23 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647216:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4062e3600/0x57e58d5a90c7ef10 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb323e expref: 22 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647223:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff95e5044f6600)
00010000:00010000:0.0:1782361994.647225:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.647227:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4062e3600, rc 0)
00010000:00010000:0.0:1782361994.647230:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.647237:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7ef17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3245 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647261:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647268:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647275:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647286:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647292:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647298:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647474:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647483:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647489:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.647501:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x33:0x0]: returning size 6
00000004:00200000:0.0:1782361994.647504:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.647512:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647527:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647534:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647540:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647547:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647551:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af600 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.647554:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647560:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647567:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.647569:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.647571:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647576:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7ef1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647585:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647590:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647600:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647604:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae000 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.647607:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647613:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647619:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x737b65d2 (ffff95e5420d9900)
00010000:00010000:0.0:1782361994.647621:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.647624:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647629:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7ef25 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647649:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7ef17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3245 expref: 24 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647661:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aee00/0x57e58d5a90c7ef2c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3245 expref: 23 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647667:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff95e5420d9800)
00010000:00010000:0.0:1782361994.647669:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.647671:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055aee00, rc 0)
00010000:00010000:0.0:1782361994.647674:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.647680:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7ef33 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb324c expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.647706:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648090:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648097:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648110:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648117:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648123:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648304:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648313:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648320:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.648333:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x34:0x0]: returning size 7
00000004:00200000:0.0:1782361994.648336:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.648345:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648362:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648369:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648375:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648381:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648386:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.648389:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648395:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648402:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.648405:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.648407:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648413:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7ef3a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648421:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648427:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648437:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648442:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055afe00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.648445:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648450:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648458:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x260a9c01 (ffff95e5420d9400)
00010000:00010000:0.0:1782361994.648461:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.648464:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648470:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7ef41 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648490:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7ef33 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb324c expref: 25 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648502:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae200/0x57e58d5a90c7ef48 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb324c expref: 24 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648508:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x34:0x0].0x0 (ffff95e5420d9d00)
00010000:00010000:0.0:1782361994.648511:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.648513:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055ae200, rc 0)
00010000:00010000:0.0:1782361994.648516:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.648522:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae600/0x57e58d5a90c7ef4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3253 expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648548:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648556:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648562:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648572:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648578:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.648584:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:1.0:1782361994.648974:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.649012:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985141632
00000100:00100000:2.0:1782361994.649020:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985141632
00010000:00010000:0.0:1782361994.649054:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649065:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361994.649070:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 21
00010000:00010000:0.0:1782361994.649079:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361994.649085:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+26:30999:x1868940985141632:12345-192.168.202.24@tcp:35:grep.0
00000004:00200000:0.0:1782361994.649099:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x35:0x0]: returning size 7
00000004:00200000:0.0:1782361994.649102:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.649112:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649131:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649138:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649145:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649153:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649159:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055afc00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.649162:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649170:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649179:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.649181:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.649184:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649191:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7ef56 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649201:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649208:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649220:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649225:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af000 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.649229:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649235:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649243:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d786654 (ffff95e5420d9500)
00010000:00010000:0.0:1782361994.649246:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.649249:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649255:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7ef5d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649279:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae600/0x57e58d5a90c7ef4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3253 expref: 28 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649290:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aea00/0x57e58d5a90c7ef64 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3253 expref: 27 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649298:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x35:0x0].0x0 (ffff95e5420d9e00)
00010000:00010000:0.0:1782361994.649301:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.649303:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055aea00, rc 0)
00010000:00010000:0.0:1782361994.649307:0:6599:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.649314:0:6599:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af400/0x57e58d5a90c7ef6b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb325a expref: -99 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00000100:00100000:2.0:1782361994.649332:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:30999:x1868940985141632:12345-192.168.202.24@tcp:35:grep.0 Request processed in 250us (357us total) trans 68719476744 rc 0/0
00000100:00100000:2.0:1782361994.649342:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 21
00010000:00010000:0.0:1782361994.649343:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649353:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649362:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649377:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649385:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649392:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649585:0:6599:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649594:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649602:0:6599:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.649615:0:6599:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x36:0x0]: returning size 7
00000004:00200000:0.0:1782361994.649618:0:6599:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1
00000004:00010000:0.0:1782361994.649627:0:6599:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x5b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649658:0:6599:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649665:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649672:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649679:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649684:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.649688:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649694:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649702:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.649705:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.649719:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649725:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae800/0x57e58d5a90c7ef72 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649734:0:6599:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649739:0:6599:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649751:0:6599:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649755:0:6599:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.649758:0:6599:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649764:0:6599:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649771:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8fec2d56 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.649773:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.649777:0:6599:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649782:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af200/0x57e58d5a90c7ef79 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6599 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649805:0:6599:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af400/0x57e58d5a90c7ef6b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb325a expref: 28 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649816:0:6599:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055aec00/0x57e58d5a90c7ef80 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb325a expref: 27 pid: 6599 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.649822:0:6599:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x36:0x0].0x0 (ffff95e509f61000)
00010000:00010000:0.0:1782361994.649825:0:6599:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.649844:0:6599:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055aec00, rc 0)
00000100:00100000:0.0:1782361994.649888:0:6599:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074da680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_out00_00:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:2365:x1868940985141248:12345-192.168.202.24@tcp:63:ll_sa.0 Request processed in 4915us (5347us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361994.649904:0:6599:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 2
00000100:00100000:1.0:1782361994.657287:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.657491:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985141888
00000100:00100000:2.0:1782361994.657499:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985141888
00000100:00100000:2.0:1782361994.657546:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35
00000100:00100000:2.0:1782361994.657564:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+27:31003:x1868940985141888:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.657586:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.657603:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ef87 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3261 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657657:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657667:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657683:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657691:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657729:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.657741:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658091:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7ef9c lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658101:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7ef9c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658108:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7ef9c lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.658119:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x2f:0x0]: returning size 6
00010000:00010000:2.0:1782361994.658206:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658214:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658221:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658226:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.658230:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658237:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658259:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.658261:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.658266:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658272:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7ef8e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658285:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658292:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658298:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658303:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.658306:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658312:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658319:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x68e42da7 (ffff95e408dadc00)
00010000:00010000:2.0:1782361994.658320:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.658323:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658329:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7ef95 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x68e42da7 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658389:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7ef87 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3261 expref: 30 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658401:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7ef9c lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3261 expref: 29 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.658409:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff95e5044f6a00)
00010000:00010000:2.0:1782361994.658411:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.658413:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78600, rc 0)
00000100:00100000:2.0:1782361994.658466:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:31003:x1868940985141888:12345-192.168.202.24@tcp:101:grep.0 Request processed in 911us (1185us total) trans 68719476745 rc 0/0
00000100:00100000:2.0:1782361994.658473:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35
00000100:00100000:3.0:1782361994.661755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.662798:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142016
00000100:00100000:2.0:1782361994.662808:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142016
00000100:00100000:2.0:1782361994.662882:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 92
00000100:00100000:2.0:1782361994.662892:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:2364:x1868940985142016:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361994.662905:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361994.662925:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7ef9c lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x2f:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3261 expref: 29 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.662943:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x2f:0x0].0x0 (ffff95e5044f6a00)
00010000:00010000:2.0:1782361994.662948:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361994.662956:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.662995:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518355180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:2364:x1868940985142016:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (1246us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361994.663002:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 92
00000100:00100000:0.0:1782361994.663023:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142144
00000100:00100000:0.0:1782361994.663030:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142144
00002000:00100000:0.0:1782361994.663063:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c4:0x0] (0->4095)  req@ffff95e4074dad80 x1868940985142144/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.663074:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074dad80 with x1868940985142144 ext(0->4095)
00002000:00010000:0.0:1782361994.663080:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e4074dad80
00000100:00100000:0.0:1782361994.663109:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 244
00000100:00100000:0.0:1782361994.663118:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2362:x1868940985142144:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:0.0:1782361994.663304:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074dad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2362:x1868940985142144:12345-192.168.202.24@tcp:3:grep.0 Request processed in 188us (350us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1782361994.663309:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 244
00002000:00100000:0.0:1782361994.663313:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c4:0x0] (0->4095)  req@ffff95e4074dad80 x1868940985142144/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.663319:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074dad80 with x1868940985142144 ext(0->4095)
00002000:00010000:0.0:1782361994.663321:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e4074dad80
00000100:00100000:3.0:1782361994.668120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.668953:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142400
00000100:00100000:2.0:1782361994.668965:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142400
00000100:00100000:2.0:1782361994.669018:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 22
00000100:00100000:2.0:1782361994.669029:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+28:31003:x1868940985142400:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.669333:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518356300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:31003:x1868940985142400:12345-192.168.202.24@tcp:35:grep.0 Request processed in 305us (1222us total) trans 68719476746 rc 0/0
00000100:00100000:2.0:1782361994.669342:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 22
00000100:00100000:3.0:1782361994.679150:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.679229:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142656
00000100:00100000:2.0:1782361994.679238:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142656
00000100:00100000:2.0:1782361994.679298:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 36
00000100:00100000:2.0:1782361994.679309:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+29:31004:x1868940985142656:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.679335:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.679356:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efaa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3268 expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679429:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679442:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679452:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679464:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679471:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679494:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679886:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efbf lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679896:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efbf lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.679905:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efbf lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.679917:0:35402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x30:0x0]: returning size 6
00010000:00010000:0.0:1782361994.680046:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680056:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680063:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680069:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.680079:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680085:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680095:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.680097:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.680102:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680115:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7efb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680133:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680139:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680145:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680150:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78c00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.680153:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680159:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680167:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7d261ae4 (ffff95e408dadc00)
00010000:00010000:0.0:1782361994.680169:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.680178:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680182:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efb8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7d261ae4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680234:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efaa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3268 expref: 32 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680247:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efbf lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3268 expref: 31 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.680254:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff95e5044f6e00)
00010000:00010000:0.0:1782361994.680257:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.680259:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78a00, rc 0)
00000100:00100000:0.0:1782361994.680324:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518355880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:31004:x1868940985142656:12345-192.168.202.24@tcp:101:grep.0 Request processed in 1016us (1181us total) trans 68719476747 rc 0/0
00000100:00100000:0.0:1782361994.680331:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 36
00000100:00100000:1.0:1782361994.684244:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.684764:0:5775:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142784
00000100:00100000:3.0:1782361994.684774:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.684775:0:5775:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142784
00000100:00100000:2.0:1782361994.684903:0:5775:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 93
00000100:00100000:2.0:1782361994.684914:0:5775:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:2364:x1868940985142784:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361994.684929:0:5775:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361994.684952:0:5775:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efbf lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x30:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3268 expref: 31 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.684970:0:5775:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x30:0x0].0x0 (ffff95e5044f6e00)
00010000:00010000:2.0:1782361994.684975:0:5775:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:1.0:1782361994.684983:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985142912
00000100:00100000:1.0:1782361994.684988:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985142912
00002000:00100000:1.0:1782361994.685017:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c4:0x0] (0->4095)  req@ffff95e518354700 x1868940985142912/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.685025:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e518354700 with x1868940985142912 ext(0->4095)
00002000:00010000:1.0:1782361994.685029:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e518354700
00000100:00100000:2.0:1782361994.685037:0:5775:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:2364:x1868940985142784:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 123us (799us total) trans 0 rc 0/0
00000100:00100000:1.0:1782361994.685047:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 245
00000100:00100000:1.0:1782361994.685054:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2362:x1868940985142912:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.685056:0:5775:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 93
00000100:00100000:1.0:1782361994.685616:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518354700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2362:x1868940985142912:12345-192.168.202.24@tcp:3:grep.0 Request processed in 561us (842us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1782361994.685622:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 245
00002000:00100000:1.0:1782361994.685632:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c4:0x0] (0->4095)  req@ffff95e518354700 x1868940985142912/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.685638:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e518354700 with x1868940985142912 ext(0->4095)
00002000:00010000:1.0:1782361994.685641:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e518354700
00000100:00100000:3.0:1782361994.696618:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.696701:0:35411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985143168
00000100:00100000:1.0:1782361994.696721:0:35411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985143168
00000100:00100000:1.0:1782361994.696781:0:35411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 23
00000100:00100000:1.0:1782361994.696792:0:35411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53cd09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+30:31004:x1868940985143168:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:1.0:1782361994.697133:0:35411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53cd09450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:31004:x1868940985143168:12345-192.168.202.24@tcp:35:grep.0 Request processed in 342us (521us total) trans 68719476748 rc 0/0
00000100:00100000:1.0:1782361994.697142:0:35411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 23
00000100:00100000:3.0:1782361994.706045:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.706172:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985143424
00000100:00100000:2.0:1782361994.706183:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985143424
00000100:00100000:2.0:1782361994.706248:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 37
00000100:00100000:2.0:1782361994.706258:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+31:31005:x1868940985143424:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.706291:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.706310:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efcd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb326f expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706377:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706391:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706402:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706417:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706424:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706430:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706775:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efe2 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706784:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efe2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.706791:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efe2 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.706994:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x31:0x0]: returning size 6
00010000:00010000:2.0:1782361994.707077:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707085:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707091:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707096:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.707100:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707167:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707179:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.707182:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.707187:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707193:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7efd4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707207:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707213:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707230:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707234:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.707237:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707244:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707252:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x223991a9 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.707254:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.707257:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707263:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7efdb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x223991a9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707315:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7efcd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb326f expref: 34 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707329:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efe2 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb326f expref: 33 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.707336:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff95e5044f6500)
00010000:00010000:2.0:1782361994.707338:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.707341:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78c00, rc 0)
00000100:00100000:2.0:1782361994.707406:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518354e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:31005:x1868940985143424:12345-192.168.202.24@tcp:101:grep.0 Request processed in 1149us (1371us total) trans 68719476749 rc 0/0
00000100:00100000:2.0:1782361994.707421:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 37
00000100:00100000:0.0:1782361994.709363:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361994.709413:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985143552
00000100:00100000:3.0:1782361994.709421:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985143552
00000100:00100000:3.0:1782361994.709477:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 94
00000100:00100000:3.0:1782361994.709487:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:2363:x1868940985143552:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361994.709500:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361994.709517:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7efe2 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x31:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb326f expref: 33 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361994.709532:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x31:0x0].0x0 (ffff95e5044f6500)
00010000:00010000:3.0:1782361994.709536:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361994.709578:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:2363:x1868940985143552:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 93us (219us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361994.709597:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 94
00000100:00100000:3.0:1782361994.710161:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.710213:0:34479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985143680
00000100:00100000:1.0:1782361994.710219:0:34479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985143680
00002000:00100000:1.0:1782361994.710252:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c5:0x0] (0->4095)  req@ffff95e518356a00 x1868940985143680/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.710262:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e518356a00 with x1868940985143680 ext(0->4095)
00002000:00010000:1.0:1782361994.710267:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e518356a00
00000100:00100000:1.0:1782361994.710302:0:34479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 246
00000100:00100000:1.0:1782361994.710310:0:34479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985143680:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:1.0:1782361994.710492:0:34479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518356a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985143680:12345-192.168.202.24@tcp:3:grep.0 Request processed in 182us (330us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1782361994.710499:0:34479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 246
00002000:00100000:1.0:1782361994.710505:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c5:0x0] (0->4095)  req@ffff95e518356a00 x1868940985143680/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.710524:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e518356a00 with x1868940985143680 ext(0->4095)
00002000:00010000:1.0:1782361994.710528:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e518356a00
00000100:00100000:1.0:1782361994.715741:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.715973:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985143936
00000100:00100000:0.0:1782361994.715982:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985143936
00000100:00100000:0.0:1782361994.716038:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 24
00000100:00100000:0.0:1782361994.716048:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+32:31005:x1868940985143936:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.716480:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:31005:x1868940985143936:12345-192.168.202.24@tcp:35:grep.0 Request processed in 432us (746us total) trans 68719476750 rc 0/0
00000100:00100000:0.0:1782361994.716488:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 24
00000100:00100000:0.0:1782361994.725180:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.725298:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985144192
00000100:00100000:2.0:1782361994.725308:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985144192
00000100:00100000:2.0:1782361994.725362:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 38
00000100:00100000:2.0:1782361994.725372:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+33:31006:x1868940985144192:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.725394:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.725413:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7eff0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3276 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725479:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725492:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725502:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725514:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725521:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725527:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725920:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f005 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725941:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f005 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.725948:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f005 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.725957:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x32:0x0]: returning size 6
00010000:00010000:2.0:1782361994.726052:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726060:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726067:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726072:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78600 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.726076:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726082:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726094:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.726096:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.726099:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726104:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7eff7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726112:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726121:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726124:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726127:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.726129:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726132:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726137:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xb1133e6 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.726138:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.726140:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726143:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7effe lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xb1133e6 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726181:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7eff0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3276 expref: 36 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726189:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f005 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3276 expref: 35 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.726193:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff95e5044f6600)
00010000:00010000:2.0:1782361994.726194:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.726199:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c79a00, rc 0)
00000100:00100000:2.0:1782361994.726254:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db61500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:31006:x1868940985144192:12345-192.168.202.24@tcp:101:grep.0 Request processed in 884us (1083us total) trans 68719476751 rc 0/0
00000100:00100000:2.0:1782361994.726262:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 38
00000100:00100000:3.0:1782361994.727866:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.727903:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985144320
00000100:00100000:2.0:1782361994.727913:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985144320
00000100:00100000:2.0:1782361994.727961:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 95
00000100:00100000:2.0:1782361994.727970:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518628850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:2363:x1868940985144320:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361994.727982:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361994.727998:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f005 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x32:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3276 expref: 35 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.728011:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x32:0x0].0x0 (ffff95e5044f6600)
00010000:00010000:2.0:1782361994.728014:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361994.728064:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518628850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+34:2363:x1868940985144320:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 92us (199us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361994.728071:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 95
00000100:00100000:1.0:1782361994.732262:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.732379:0:34480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985144448
00000100:00100000:2.0:1782361994.732389:0:34480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985144448
00002000:00100000:2.0:1782361994.732435:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c5:0x0] (0->4095)  req@ffff95e4074dbb80 x1868940985144448/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.732447:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074dbb80 with x1868940985144448 ext(0->4095)
00002000:00010000:2.0:1782361994.732452:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074dbb80
00000100:00100000:2.0:1782361994.732486:0:34480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 247
00000100:00100000:2.0:1782361994.732496:0:34480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985144448:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.732905:0:34480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985144448:12345-192.168.202.24@tcp:3:grep.0 Request processed in 410us (652us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.732914:0:34480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 247
00002000:00100000:2.0:1782361994.732919:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c5:0x0] (0->4095)  req@ffff95e4074dbb80 x1868940985144448/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.732925:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074dbb80 with x1868940985144448 ext(0->4095)
00002000:00010000:2.0:1782361994.732927:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074dbb80
00000100:00100000:0.0:1782361994.736035:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.736399:0:35411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985144704
00000100:00100000:1.0:1782361994.736408:0:35411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985144704
00000100:00100000:1.0:1782361994.736462:0:35411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 25
00000100:00100000:1.0:1782361994.736473:0:35411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+34:31006:x1868940985144704:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:1.0:1782361994.736764:0:35411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53db60e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:31006:x1868940985144704:12345-192.168.202.24@tcp:35:grep.0 Request processed in 292us (735us total) trans 68719476752 rc 0/0
00000100:00100000:1.0:1782361994.736772:0:35411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 25
00000100:00100000:3.0:1782361994.744916:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.744979:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985144960
00000100:00100000:0.0:1782361994.744989:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985144960
00000100:00100000:0.0:1782361994.745057:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 39
00000100:00100000:0.0:1782361994.745117:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+35:31007:x1868940985144960:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:0.0:1782361994.745142:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.745165:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7f013 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb327d expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745223:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745233:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745240:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745249:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745253:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745259:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745598:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7f028 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745607:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7f028 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745624:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7f028 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.745634:0:35402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x33:0x0]: returning size 6
00010000:00010000:0.0:1782361994.745738:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745745:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745750:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745757:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055afc00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.745760:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745767:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745779:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.745782:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.745786:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745798:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afc00/0x57e58d5a90c7f01a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745809:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745824:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745876:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745882:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055afa00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.745885:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745890:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745897:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x737b65d2 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.745900:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.745903:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745908:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f021 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x737b65d2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745947:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af000/0x57e58d5a90c7f013 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb327d expref: 38 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745960:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7f028 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb327d expref: 37 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.745967:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff95e5420d9800)
00010000:00010000:0.0:1782361994.745969:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.745976:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055afe00, rc 0)
00000100:00100000:0.0:1782361994.746037:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518355180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:31007:x1868940985144960:12345-192.168.202.24@tcp:101:grep.0 Request processed in 971us (1128us total) trans 68719476753 rc 0/0
00000100:00100000:0.0:1782361994.746044:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 39
00000100:00100000:3.0:1782361994.750900:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361994.750994:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.751029:0:32541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145216
00000100:00100000:0.0:1782361994.751041:0:32541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145216
00000100:00100000:2.0:1782361994.751101:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145088
00002000:00100000:0.0:1782361994.751113:0:32541:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c6:0x0] (0->4095)  req@ffff95e40543ca80 x1868940985145216/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00000100:00100000:2.0:1782361994.751115:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145088
00002000:00100000:0.0:1782361994.751126:0:32541:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543ca80 with x1868940985145216 ext(0->4095)
00002000:00010000:0.0:1782361994.751132:0:32541:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543ca80
00000100:00100000:0.0:1782361994.751162:0:32541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 248
00000100:00100000:0.0:1782361994.751172:0:32541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e40543ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985145216:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.751249:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 96
00000100:00100000:2.0:1782361994.751259:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e518356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:2362:x1868940985145088:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361994.751271:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361994.751294:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afe00/0x57e58d5a90c7f028 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x33:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb327d expref: 37 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.751312:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x33:0x0].0x0 (ffff95e5420d9800)
00010000:00010000:2.0:1782361994.751317:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361994.751377:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e518356300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:2362:x1868940985145088:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 117us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361994.751385:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 96
00000100:00100000:0.0:1782361994.751400:0:32541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e40543ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985145216:12345-192.168.202.24@tcp:3:grep.0 Request processed in 227us (402us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1782361994.751408:0:32541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 248
00002000:00100000:0.0:1782361994.751415:0:32541:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c6:0x0] (0->4095)  req@ffff95e40543ca80 x1868940985145216/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.751424:0:32541:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543ca80 with x1868940985145216 ext(0->4095)
00002000:00010000:0.0:1782361994.751428:0:32541:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543ca80
00000100:00100000:1.0:1782361994.755731:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.755784:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145472
00000100:00100000:0.0:1782361994.755791:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145472
00000100:00100000:0.0:1782361994.755861:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 26
00000100:00100000:0.0:1782361994.755871:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+36:31007:x1868940985145472:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.756123:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:31007:x1868940985145472:12345-192.168.202.24@tcp:35:grep.0 Request processed in 253us (416us total) trans 68719476754 rc 0/0
00000100:00100000:0.0:1782361994.756148:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 26
00000100:00100000:0.0:1782361994.762814:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.762883:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145728
00000100:00100000:2.0:1782361994.762896:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145728
00000100:00100000:2.0:1782361994.762952:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 40
00000100:00100000:2.0:1782361994.762965:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e50475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+37:31008:x1868940985145728:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.762988:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.763008:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f036 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3284 expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763108:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763122:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763132:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763146:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763154:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763160:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763492:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f04b lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763500:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f04b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763507:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f04b lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.763516:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x34:0x0]: returning size 7
00010000:00010000:2.0:1782361994.763599:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763615:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763622:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763627:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.763632:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763638:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763650:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.763653:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.763658:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763664:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f03d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763677:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763683:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763689:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763695:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.763703:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763723:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763732:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x260a9c01 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.763734:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.763738:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763743:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f044 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x260a9c01 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763803:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f036 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3284 expref: 40 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763817:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f04b lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3284 expref: 39 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.763824:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x34:0x0].0x0 (ffff95e5420d9d00)
00010000:00010000:2.0:1782361994.763847:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.763850:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78600, rc 0)
00000100:00100000:2.0:1782361994.763908:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e50475bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:31008:x1868940985145728:12345-192.168.202.24@tcp:101:grep.0 Request processed in 946us (1099us total) trans 68719476755 rc 0/0
00000100:00100000:2.0:1782361994.763916:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 40
00000100:00100000:1.0:1782361994.766224:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361994.766312:0:8302:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145856
00000100:00100000:3.0:1782361994.766321:0:8302:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145856
00000100:00100000:3.0:1782361994.766418:0:8302:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 97
00000100:00100000:3.0:1782361994.766428:0:8302:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:2362:x1868940985145856:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361994.766442:0:8302:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361994.766462:0:8302:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f04b lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x34:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3284 expref: 39 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361994.766478:0:8302:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x34:0x0].0x0 (ffff95e5420d9d00)
00010000:00010000:3.0:1782361994.766483:0:8302:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361994.766529:0:8302:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:2362:x1868940985145856:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 104us (313us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361994.766535:0:8302:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 97
00000100:00100000:1.0:1782361994.766887:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.767083:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985145984
00000100:00100000:2.0:1782361994.767087:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985145984
00002000:00100000:2.0:1782361994.767112:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c6:0x0] (0->4095)  req@ffff95e4074d8000 x1868940985145984/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.767137:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074d8000 with x1868940985145984 ext(0->4095)
00002000:00010000:2.0:1782361994.767141:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074d8000
00000100:00100000:2.0:1782361994.767168:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 249
00000100:00100000:2.0:1782361994.767176:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985145984:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.767366:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4074d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985145984:12345-192.168.202.24@tcp:3:grep.0 Request processed in 189us (478us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.767373:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 249
00002000:00100000:2.0:1782361994.767381:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c6:0x0] (0->4095)  req@ffff95e4074d8000 x1868940985145984/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.767389:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e4074d8000 with x1868940985145984 ext(0->4095)
00002000:00010000:2.0:1782361994.767393:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e4074d8000
00000100:00100000:0.0:1782361994.769813:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.770055:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985146240
00000100:00100000:2.0:1782361994.770064:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985146240
00000100:00100000:2.0:1782361994.770111:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 27
00000100:00100000:2.0:1782361994.770120:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53603a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+38:31008:x1868940985146240:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.770401:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53603a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:31008:x1868940985146240:12345-192.168.202.24@tcp:35:grep.0 Request processed in 282us (595us total) trans 68719476756 rc 0/0
00000100:00100000:2.0:1782361994.770408:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 27
00000100:00100000:1.0:1782361994.777072:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.778153:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985146496
00000100:00100000:2.0:1782361994.778165:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985146496
00000100:00100000:2.0:1782361994.778226:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 41
00000100:00100000:2.0:1782361994.778239:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+39:31009:x1868940985146496:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.778262:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.778295:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f059 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb328b expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778361:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778374:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778385:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778399:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778406:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778412:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778785:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f06e lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778794:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f06e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778801:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f06e lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.778810:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x35:0x0]: returning size 7
00010000:00010000:2.0:1782361994.778926:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778943:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778949:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778955:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.778959:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778967:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778980:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.778982:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.778987:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.778993:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f060 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779005:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779011:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779016:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779021:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.779030:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779037:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779045:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x4d786654 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.779048:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.779063:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779069:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f067 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x4d786654 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779118:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f059 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb328b expref: 42 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779132:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f06e lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb328b expref: 41 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.779139:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x35:0x0].0x0 (ffff95e5420d9e00)
00010000:00010000:2.0:1782361994.779142:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.779144:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78600, rc 0)
00000100:00100000:2.0:1782361994.779204:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:31009:x1868940985146496:12345-192.168.202.24@tcp:101:grep.0 Request processed in 968us (2137us total) trans 68719476757 rc 0/0
00000100:00100000:2.0:1782361994.779213:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 41
00000100:00100000:1.0:1782361994.780669:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.780726:0:5777:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985146624
00000100:00100000:2.0:1782361994.780734:0:5777:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985146624
00000100:00100000:2.0:1782361994.780773:0:5777:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 98
00000100:00100000:2.0:1782361994.780783:0:5777:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:2363:x1868940985146624:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:2.0:1782361994.780805:0:5777:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:2.0:1782361994.780817:0:5777:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f06e lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x35:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb328b expref: 41 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.780840:0:5777:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x35:0x0].0x0 (ffff95e5420d9e00)
00010000:00010000:2.0:1782361994.780844:0:5777:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:2.0:1782361994.780880:0:5777:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e503ea4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:2363:x1868940985146624:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 100us (216us total) trans 0 rc 0/0
00000100:00100000:2.0:1782361994.780887:0:5777:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 98
00000100:00100000:0.0:1782361994.781751:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.781790:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985146752
00000100:00100000:2.0:1782361994.781796:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985146752
00002000:00100000:2.0:1782361994.781821:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c7:0x0] (0->4095)  req@ffff95e536038000 x1868940985146752/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.781846:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e536038000 with x1868940985146752 ext(0->4095)
00002000:00010000:2.0:1782361994.781851:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e536038000
00000100:00100000:2.0:1782361994.781877:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 250
00000100:00100000:2.0:1782361994.781888:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e536038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985146752:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.782092:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e536038000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985146752:12345-192.168.202.24@tcp:3:grep.0 Request processed in 206us (343us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.782100:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 250
00002000:00100000:2.0:1782361994.782106:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1c7:0x0] (0->4095)  req@ffff95e536038000 x1868940985146752/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.782115:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e536038000 with x1868940985146752 ext(0->4095)
00002000:00010000:2.0:1782361994.782119:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e536038000
00000100:00100000:1.0:1782361994.787947:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.788003:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985147008
00000100:00100000:0.0:1782361994.788013:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985147008
00000100:00100000:0.0:1782361994.788069:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 28
00000100:00100000:0.0:1782361994.788080:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+40:31009:x1868940985147008:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.788382:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:31009:x1868940985147008:12345-192.168.202.24@tcp:35:grep.0 Request processed in 304us (445us total) trans 68719476758 rc 0/0
00000100:00100000:0.0:1782361994.788387:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 28
00000100:00100000:1.0:1782361994.794060:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.794139:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985147264
00000100:00100000:0.0:1782361994.794150:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985147264
00000100:00100000:0.0:1782361994.794211:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 42
00000100:00100000:0.0:1782361994.794221:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+41:31010:x1868940985147264:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:0.0:1782361994.794243:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.794262:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f07c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3292 expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794329:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794342:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794352:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794382:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794390:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794396:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794786:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f091 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794796:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f091 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794803:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f091 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.794813:0:35402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x36:0x0]: returning size 7
00010000:00010000:0.0:1782361994.794933:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794940:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794946:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794952:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae400 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.794955:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794971:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794983:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.794986:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.794990:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.794996:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f083 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795005:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795009:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795012:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795015:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae000 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.795017:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795020:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795024:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x8fec2d56 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.795025:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.795027:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795036:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f08a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x8fec2d56 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795065:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f07c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3292 expref: 44 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795073:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f091 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3292 expref: 43 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.795078:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x36:0x0].0x0 (ffff95e509f61000)
00010000:00010000:0.0:1782361994.795080:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.795081:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055af600, rc 0)
00000100:00100000:0.0:1782361994.795130:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:31010:x1868940985147264:12345-192.168.202.24@tcp:101:grep.0 Request processed in 911us (1076us total) trans 68719476759 rc 0/0
00000100:00100000:0.0:1782361994.795138:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 42
00000100:00100000:1.0:1782361994.796892:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361994.796938:0:5776:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985147392
00000100:00100000:3.0:1782361994.796945:0:5776:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985147392
00000100:00100000:3.0:1782361994.796988:0:5776:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 99
00000100:00100000:3.0:1782361994.796998:0:5776:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:2362:x1868940985147392:12345-192.168.202.24@tcp:103:ldlm_bl.0
00010000:00010000:3.0:1782361994.797010:0:5776:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00010000:3.0:1782361994.797026:0:5776:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f091 lrc: 0/0,0 mode: --/PR res: [0x200001b71:0x36:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3292 expref: 43 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:3.0:1782361994.797052:0:5776:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x36:0x0].0x0 (ffff95e509f61000)
00010000:00010000:3.0:1782361994.797057:0:5776:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:3.0:1782361994.797106:0:5776:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:2362:x1868940985147392:12345-192.168.202.24@tcp:103:ldlm_bl.0 Request processed in 110us (216us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361994.797113:0:5776:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 99
00000100:00100000:1.0:1782361994.798308:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.798381:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985147520
00000100:00100000:2.0:1782361994.798386:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985147520
00002000:00100000:2.0:1782361994.798419:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c7:0x0] (0->4095)  req@ffff95e53602c380 x1868940985147520/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.798428:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e53602c380 with x1868940985147520 ext(0->4095)
00002000:00010000:2.0:1782361994.798433:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e53602c380
00000100:00100000:2.0:1782361994.798457:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 251
00000100:00100000:2.0:1782361994.798465:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985147520:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.798676:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985147520:12345-192.168.202.24@tcp:3:grep.0 Request processed in 211us (371us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.798684:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 251
00002000:00100000:2.0:1782361994.798690:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1c7:0x0] (0->4095)  req@ffff95e53602c380 x1868940985147520/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.798699:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e53602c380 with x1868940985147520 ext(0->4095)
00002000:00010000:2.0:1782361994.798702:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e53602c380
00010000:00010000:0.0:1782361994.798948:0:5778:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000100:00100000:1.0:1782361994.800786:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.800862:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985147776
00000100:00100000:2.0:1782361994.800869:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985147776
00000100:00100000:2.0:1782361994.800951:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 29
00000100:00100000:2.0:1782361994.800960:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53cd0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+42:31010:x1868940985147776:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.801188:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53cd0b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:31010:x1868940985147776:12345-192.168.202.24@tcp:35:grep.0 Request processed in 228us (409us total) trans 68719476760 rc 0/0
00000100:00100000:2.0:1782361994.801196:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 29
00000100:00100000:1.0:1782361994.807120:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.807218:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985148032
00000100:00100000:2.0:1782361994.807227:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985148032
00000100:00100000:2.0:1782361994.807271:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 43
00000100:00100000:2.0:1782361994.807289:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+43:31011:x1868940985148032:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.807309:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.807326:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f09f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb3299 expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807392:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807406:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807417:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807431:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807438:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807443:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807703:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f0b4 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x37:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807725:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f0b4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807732:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f0b4 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.807751:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x37:0x0]: returning size 7
00010000:00010000:2.0:1782361994.807856:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807864:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807871:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807878:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.807882:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807889:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807902:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.807905:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.807910:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807917:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0a6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807929:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807935:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807950:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807956:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.807959:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807965:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807973:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x2df3dbba (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.807976:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.807978:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.807984:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0ad lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x2df3dbba bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.808035:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f09f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3299 expref: 46 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.808048:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79200/0x57e58d5a90c7f0b4 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x37:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb3299 expref: 45 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.808055:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x37:0x0].0x0 (ffff95e408dad700)
00010000:00010000:2.0:1782361994.808058:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.808060:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c79200, rc 0)
00000100:00100000:2.0:1782361994.808159:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:31011:x1868940985148032:12345-192.168.202.24@tcp:101:grep.0 Request processed in 870us (1048us total) trans 68719476761 rc 0/0
00000100:00100000:2.0:1782361994.808175:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 43
00000100:00100000:3.0:1782361994.812368:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361994.812425:0:34479:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985148160
00000100:00100000:1.0:1782361994.812433:0:34479:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985148160
00002000:00100000:1.0:1782361994.812470:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c8:0x0] (0->4095)  req@ffff95e40543c700 x1868940985148160/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.812491:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543c700 with x1868940985148160 ext(0->4095)
00002000:00010000:1.0:1782361994.812496:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543c700
00000100:00100000:1.0:1782361994.812519:0:34479:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 252
00000100:00100000:1.0:1782361994.812525:0:34479:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e40543c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985148160:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:1.0:1782361994.812755:0:34479:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e40543c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985148160:12345-192.168.202.24@tcp:3:grep.0 Request processed in 227us (393us total) trans 0 rc 4096/4096
00000100:00100000:1.0:1782361994.812762:0:34479:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 252
00002000:00100000:1.0:1782361994.812769:0:34479:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_004: refresh rw locks for [0x240000400:0x1c8:0x0] (0->4095)  req@ffff95e40543c700 x1868940985148160/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:1.0:1782361994.812778:0:34479:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543c700 with x1868940985148160 ext(0->4095)
00002000:00010000:1.0:1782361994.812781:0:34479:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543c700
00000100:00100000:1.0:1782361994.817281:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.817373:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985148416
00000100:00100000:0.0:1782361994.817382:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985148416
00000100:00100000:0.0:1782361994.817434:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 30
00000100:00100000:0.0:1782361994.817443:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+45:31011:x1868940985148416:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.817733:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:31011:x1868940985148416:12345-192.168.202.24@tcp:35:grep.0 Request processed in 289us (458us total) trans 68719476762 rc 0/0
00000100:00100000:0.0:1782361994.817742:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 30
00000100:00100000:0.0:1782361994.823559:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.823607:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985148672
00000100:00100000:2.0:1782361994.823617:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985148672
00000100:00100000:2.0:1782361994.823670:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 44
00000100:00100000:2.0:1782361994.823682:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53603bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+46:31012:x1868940985148672:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.823704:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.823735:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f0c2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32a0 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823810:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823821:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823856:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823872:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823879:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.823908:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824190:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7f0d7 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x38:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824207:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7f0d7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824211:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7f0d7 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.824219:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x38:0x0]: returning size 7
00010000:00010000:2.0:1782361994.824297:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824302:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824306:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824310:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.824314:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824321:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824333:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.824336:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.824340:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824347:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f0c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824366:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824378:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824385:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824396:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.824400:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824406:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824414:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x843bbeb4 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.824417:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.824420:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824426:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f0d0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x843bbeb4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824473:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f0c2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32a0 expref: 49 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824486:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78c00/0x57e58d5a90c7f0d7 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x38:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32a0 expref: 48 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.824493:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x38:0x0].0x0 (ffff95e408dadd00)
00010000:00010000:2.0:1782361994.824495:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.824503:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e408c78c00, rc 0)
00000100:00100000:2.0:1782361994.824553:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53603bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:31012:x1868940985148672:12345-192.168.202.24@tcp:101:grep.0 Request processed in 875us (1004us total) trans 68719476763 rc 0/0
00000100:00100000:2.0:1782361994.824558:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 44
00000100:00100000:3.0:1782361994.827193:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.827253:0:34480:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985148800
00000100:00100000:0.0:1782361994.827260:0:34480:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985148800
00002000:00100000:0.0:1782361994.827303:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c8:0x0] (0->4095)  req@ffff95e40543ce00 x1868940985148800/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.827314:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543ce00 with x1868940985148800 ext(0->4095)
00002000:00010000:0.0:1782361994.827319:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e40543ce00
00000100:00100000:0.0:1782361994.827342:0:34480:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 253
00000100:00100000:0.0:1782361994.827348:0:34480:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e40543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985148800:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:0.0:1782361994.827525:0:34480:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e40543ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985148800:12345-192.168.202.24@tcp:3:grep.0 Request processed in 176us (337us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1782361994.827533:0:34480:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 253
00002000:00100000:0.0:1782361994.827539:0:34480:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_005: refresh rw locks for [0x280000400:0x1c8:0x0] (0->4095)  req@ffff95e40543ce00 x1868940985148800/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.827546:0:34480:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543ce00 with x1868940985148800 ext(0->4095)
00002000:00010000:0.0:1782361994.827549:0:34480:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e40543ce00
00000100:00100000:1.0:1782361994.829087:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.829177:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985149056
00000100:00100000:2.0:1782361994.829182:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985149056
00000100:00100000:2.0:1782361994.829210:0:34979:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 31
00000100:00100000:2.0:1782361994.829216:0:34979:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+48:31012:x1868940985149056:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:2.0:1782361994.829449:0:34979:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:31012:x1868940985149056:12345-192.168.202.24@tcp:35:grep.0 Request processed in 232us (364us total) trans 68719476764 rc 0/0
00000100:00100000:2.0:1782361994.829456:0:34979:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 31
00000100:00100000:1.0:1782361994.834020:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.834083:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985149312
00000100:00100000:0.0:1782361994.834091:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985149312
00000100:00100000:0.0:1782361994.834140:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 45
00000100:00100000:0.0:1782361994.834150:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+49:31013:x1868940985149312:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:0.0:1782361994.834168:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.834186:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f0e5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32a7 expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834246:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834259:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834285:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834299:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834306:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834312:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834661:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f0fa lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x39:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834670:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f0fa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834677:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f0fa lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:0.0:1782361994.834686:0:35402:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x39:0x0]: returning size 7
00010000:00010000:0.0:1782361994.834781:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834789:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834796:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834801:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae400 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.834811:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834818:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834869:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.834873:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.834877:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834883:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f0ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834894:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834899:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834904:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834909:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.834911:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834916:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834922:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e520668 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.834925:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.834933:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834939:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f0f3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e520668 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834975:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f0e5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32a7 expref: 52 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834987:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af600/0x57e58d5a90c7f0fa lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x39:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32a7 expref: 51 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.834995:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x39:0x0].0x0 (ffff95e509f61f00)
00010000:00010000:0.0:1782361994.834997:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.834999:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055af600, rc 0)
00000100:00100000:0.0:1782361994.835049:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:31013:x1868940985149312:12345-192.168.202.24@tcp:101:grep.0 Request processed in 900us (1033us total) trans 68719476765 rc 0/0
00000100:00100000:0.0:1782361994.835057:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 45
00000100:00100000:3.0:1782361994.837262:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.837384:0:32541:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985149440
00000100:00100000:0.0:1782361994.837393:0:32541:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985149440
00002000:00100000:0.0:1782361994.837426:0:32541:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c9:0x0] (0->4095)  req@ffff95e40543dc00 x1868940985149440/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.837438:0:32541:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543dc00 with x1868940985149440 ext(0->4095)
00002000:00010000:0.0:1782361994.837442:0:32541:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543dc00
00000100:00100000:0.0:1782361994.837467:0:32541:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 254
00000100:00100000:0.0:1782361994.837476:0:32541:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e40543dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985149440:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:0.0:1782361994.837666:0:32541:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e40543dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985149440:12345-192.168.202.24@tcp:3:grep.0 Request processed in 190us (407us total) trans 0 rc 4096/4096
00000100:00100000:0.0:1782361994.837681:0:32541:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 254
00002000:00100000:0.0:1782361994.837689:0:32541:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_003: refresh rw locks for [0x240000400:0x1c9:0x0] (0->4095)  req@ffff95e40543dc00 x1868940985149440/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:0.0:1782361994.837697:0:32541:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543dc00 with x1868940985149440 ext(0->4095)
00002000:00010000:0.0:1782361994.837700:0:32541:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e40543dc00
00000100:00100000:1.0:1782361994.839872:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.839913:0:35411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985149696
00000100:00100000:0.0:1782361994.839921:0:35411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985149696
00000100:00100000:0.0:1782361994.839967:0:35411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 32
00000100:00100000:0.0:1782361994.839976:0:35411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+51:31013:x1868940985149696:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.840229:0:35411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53602fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:31013:x1868940985149696:12345-192.168.202.24@tcp:35:grep.0 Request processed in 253us (365us total) trans 68719476766 rc 0/0
00000100:00100000:0.0:1782361994.840237:0:35411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 32
00000100:00100000:1.0:1782361994.846340:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.846398:0:34977:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985149952
00000100:00100000:2.0:1782361994.846415:0:34977:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985149952
00000100:00100000:2.0:1782361994.846470:0:34977:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 46
00000100:00100000:2.0:1782361994.846479:0:34977:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+52:31014:x1868940985149952:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.846500:0:34977:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.846516:0:34977:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f108 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32ae expref: -99 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846579:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846590:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846599:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846621:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846644:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.846651:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847046:0:34977:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9ac00/0x57e58d5a90c7f11d lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x3a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847055:0:34977:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9ac00/0x57e58d5a90c7f11d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847063:0:34977:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9ac00/0x57e58d5a90c7f11d lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.847073:0:34977:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x3a:0x0]: returning size 7
00010000:00010000:2.0:1782361994.847171:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847178:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847183:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847186:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c79a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.847189:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847194:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847210:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.847212:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.847214:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847218:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c79a00/0x57e58d5a90c7f10f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847227:0:34977:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847231:0:34977:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847234:0:34977:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847237:0:34977:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e408c78a00 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.847239:0:34977:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847242:0:34977:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847245:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x1af3bce2 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.847247:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.847248:0:34977:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847251:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78a00/0x57e58d5a90c7f116 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x1af3bce2 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34977 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847296:0:34977:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e408c78600/0x57e58d5a90c7f108 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32ae expref: 55 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847304:0:34977:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9ac00/0x57e58d5a90c7f11d lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x3a:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32ae expref: 54 pid: 34977 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.847309:0:34977:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3a:0x0].0x0 (ffff95e408dad500)
00010000:00010000:2.0:1782361994.847310:0:34977:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.847312:0:34977:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e505d9ac00, rc 0)
00000100:00100000:2.0:1782361994.847357:0:34977:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53d900700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:31014:x1868940985149952:12345-192.168.202.24@tcp:101:grep.0 Request processed in 880us (1027us total) trans 68719476767 rc 0/0
00000100:00100000:2.0:1782361994.847362:0:34977:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 46
00000100:00100000:3.0:1782361994.850032:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.850076:0:6594:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985150080
00000100:00100000:2.0:1782361994.850085:0:6594:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985150080
00002000:00100000:2.0:1782361994.850354:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c9:0x0] (0->4095)  req@ffff95e40543df80 x1868940985150080/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.850365:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543df80 with x1868940985150080 ext(0->4095)
00002000:00010000:2.0:1782361994.850370:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e40543df80
00000100:00100000:2.0:1782361994.850398:0:6594:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 255
00000100:00100000:2.0:1782361994.850407:0:6594:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e40543df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985150080:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.850636:0:6594:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e40543df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985150080:12345-192.168.202.24@tcp:3:grep.0 Request processed in 229us (610us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.850644:0:6594:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 255
00002000:00100000:2.0:1782361994.850650:0:6594:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x1c9:0x0] (0->4095)  req@ffff95e40543df80 x1868940985150080/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.850670:0:6594:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e40543df80 with x1868940985150080 ext(0->4095)
00002000:00010000:2.0:1782361994.850674:0:6594:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e40543df80
00000100:00100000:1.0:1782361994.855067:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.855111:0:34979:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985150336
00000100:00100000:2.0:1782361994.855120:0:34979:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985150336
00000100:00100000:0.0:1782361994.855212:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 33
00000100:00100000:0.0:1782361994.855225:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5047f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+54:31014:x1868940985150336:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.855487:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5047f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:31014:x1868940985150336:12345-192.168.202.24@tcp:35:grep.0 Request processed in 265us (436us total) trans 68719476768 rc 0/0
00000100:00100000:0.0:1782361994.855495:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 33
00000100:00100000:1.0:1782361994.862469:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.862564:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985150592
00000100:00100000:2.0:1782361994.862574:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985150592
00000100:00100000:2.0:1782361994.862663:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 47
00000100:00100000:2.0:1782361994.862674:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+55:31015:x1868940985150592:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:2.0:1782361994.862696:0:34976:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:2.0:1782361994.862745:0:34976:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b800/0x57e58d5a90c7f12b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32b5 expref: -99 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862817:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862857:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862871:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862887:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862895:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.862902:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863298:0:34976:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9aa00/0x57e58d5a90c7f140 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x3b:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863308:0:34976:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9aa00/0x57e58d5a90c7f140 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863316:0:34976:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9aa00/0x57e58d5a90c7f140 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00000004:00200000:2.0:1782361994.863326:0:34976:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200001b71:0x3b:0x0]: returning size 7
00010000:00010000:2.0:1782361994.863412:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863435:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863442:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863448:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505d9a200 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.863452:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863459:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863471:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:2.0:1782361994.863474:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.863480:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863496:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9a200/0x57e58d5a90c7f132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863509:0:34976:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863515:0:34976:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863522:0:34976:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863527:0:34976:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e505d9b600 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:2.0:1782361994.863530:0:34976:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863536:0:34976:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863545:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b82c607 (ffff95e408dadf00)
00010000:00010000:2.0:1782361994.863548:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:2.0:1782361994.863551:0:34976:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863557:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b600/0x57e58d5a90c7f139 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b82c607 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34976 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863607:0:34976:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9b800/0x57e58d5a90c7f12b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32b5 expref: 58 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863635:0:34976:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e505d9aa00/0x57e58d5a90c7f140 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x3b:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32b5 expref: 57 pid: 34976 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:2.0:1782361994.863643:0:34976:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3b:0x0].0x0 (ffff95e408dad100)
00010000:00010000:2.0:1782361994.863646:0:34976:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:2.0:1782361994.863648:0:34976:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e505d9aa00, rc 0)
00000100:00100000:2.0:1782361994.863718:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e5047f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:31015:x1868940985150592:12345-192.168.202.24@tcp:101:grep.0 Request processed in 1034us (1245us total) trans 68719476769 rc 0/0
00000100:00100000:2.0:1782361994.863726:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 47
00000100:00100000:1.0:1782361994.870318:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.870361:0:6596:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985150720
00000100:00100000:2.0:1782361994.870371:0:6596:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985150720
00002000:00100000:2.0:1782361994.870418:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1ca:0x0] (0->4095)  req@ffff95e52f4fe680 x1868940985150720/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.870428:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e52f4fe680 with x1868940985150720 ext(0->4095)
00002000:00010000:2.0:1782361994.870435:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e52f4fe680
00000100:00100000:2.0:1782361994.870471:0:6596:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 256
00000100:00100000:2.0:1782361994.870481:0:6596:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985150720:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.870729:0:6596:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985150720:12345-192.168.202.24@tcp:3:grep.0 Request processed in 248us (416us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.870737:0:6596:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 256
00002000:00100000:2.0:1782361994.870745:0:6596:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x1ca:0x0] (0->4095)  req@ffff95e52f4fe680 x1868940985150720/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.870751:0:6596:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e52f4fe680 with x1868940985150720 ext(0->4095)
00002000:00010000:2.0:1782361994.870759:0:6596:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff95e52f4fe680
00000100:00100000:1.0:1782361994.876954:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.877022:0:35411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985150976
00000100:00100000:0.0:1782361994.877032:0:35411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985150976
00000100:00100000:0.0:1782361994.877088:0:35411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 34
00000100:00100000:0.0:1782361994.877099:0:35411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+57:31015:x1868940985150976:12345-192.168.202.24@tcp:35:grep.0
00000100:00100000:0.0:1782361994.877387:0:35411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:31015:x1868940985150976:12345-192.168.202.24@tcp:35:grep.0 Request processed in 290us (441us total) trans 68719476770 rc 0/0
00000100:00100000:0.0:1782361994.877406:0:35411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 34
00000100:00100000:1.0:1782361994.886176:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.886240:0:35402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985151232
00000100:00100000:0.0:1782361994.886248:0:35402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985151232
00000100:00100000:0.0:1782361994.886307:0:35402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 48
00000100:00100000:0.0:1782361994.886317:0:35402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e52f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+58:31016:x1868940985151232:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:0.0:1782361994.886339:0:35402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.886356:0:35402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f14e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32bc expref: -99 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886435:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886448:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886458:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886472:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886479:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886486:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886883:0:35402:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f163 lrc: 3/1,0 mode: --/PR res: [0x200001b71:0x3c:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886912:0:35402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f163 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.886919:0:35402:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f163 lrc: 3/1,0 mode: PR/PR res: [0x200001b71:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887002:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887008:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887012:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887016:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.887018:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887023:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887031:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.887033:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.887036:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887039:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f155 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887047:0:35402:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887055:0:35402:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887059:0:35402:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887061:0:35402:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae400 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.887063:0:35402:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887068:0:35402:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887075:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3e35995 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.887077:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.887079:0:35402:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887085:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f15c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3e35995 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 35402 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887136:0:35402:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f14e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32bc expref: 61 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887150:0:35402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055afa00/0x57e58d5a90c7f163 lrc: 3/0,0 mode: PR/PR res: [0x200001b71:0x3c:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32bc expref: 60 pid: 35402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.887157:0:35402:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200001b71:0x3c:0x0].0x0 (ffff95e509f61e00)
00010000:00010000:0.0:1782361994.887159:0:35402:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b
00010000:00010000:0.0:1782361994.887168:0:35402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055afa00, rc 0)
00000100:00100000:0.0:1782361994.887224:0:35402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e52f4ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:31016:x1868940985151232:12345-192.168.202.24@tcp:101:grep.0 Request processed in 910us (1057us total) trans 68719476771 rc 0/0
00000100:00100000:0.0:1782361994.887230:0:35402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 48
00000100:00100000:1.0:1782361994.891396:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:2.0:1782361994.891457:0:6595:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985151360
00000100:00100000:2.0:1782361994.891468:0:6595:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985151360
00002000:00100000:2.0:1782361994.891514:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1ca:0x0] (0->4095)  req@ffff95e405c89880 x1868940985151360/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/0 e 0 to 0 dl 1782362005 ref 1 fl New:/600/ffffffff rc 0/-1 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.891526:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e405c89880 with x1868940985151360 ext(0->4095)
00002000:00010000:2.0:1782361994.891532:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e405c89880
00000100:00100000:2.0:1782361994.891562:0:6595:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 257
00000100:00100000:2.0:1782361994.891572:0:6595:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985151360:12345-192.168.202.24@tcp:3:grep.0
00000100:00100000:2.0:1782361994.891822:0:6595:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405c89880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2365:x1868940985151360:12345-192.168.202.24@tcp:3:grep.0 Request processed in 250us (432us total) trans 0 rc 4096/4096
00000100:00100000:2.0:1782361994.891870:0:6595:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 257
00002000:00100000:2.0:1782361994.891879:0:6595:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x1ca:0x0] (0->4095)  req@ffff95e405c89880 x1868940985151360/t0(0) o3->f4cf112e-56b0-4499-aacf-a956cfcc6c06@192.168.202.24@tcp:285/0 lens 488/4536 e 0 to 0 dl 1782362005 ref 1 fl Complete:/600/0 rc 4096/4096 job:'grep.0' uid:0 gid:0 projid:0
00002000:00100000:2.0:1782361994.891888:0:6595:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff95e405c89880 with x1868940985151360 ext(0->4095)
00002000:00010000:2.0:1782361994.891891:0:6595:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff95e405c89880
00000100:00100000:1.0:1782361994.894652:0:3300:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.894737:0:34978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985151616
00000100:00100000:0.0:1782361994.894823:0:34978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985151616
00000100:00100000:0.0:1782361994.894904:0:34978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 35
00000100:00100000:0.0:1782361994.894916:0:34978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e53cd08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+60:31016:x1868940985151616:12345-192.168.202.24@tcp:35:grep.0
00000001:00080000:0.0:1782361994.895411:0:34978:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 68719476772
00000100:00100000:0.0:1782361994.895508:0:34978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e53cd08050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:31016:x1868940985151616:12345-192.168.202.24@tcp:35:grep.0 Request processed in 590us (858us total) trans 68719476773 rc 0/0
00000100:00100000:0.0:1782361994.895517:0:34978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 35
00000020:00080000:0.0:1782361994.895522:0:34978:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC
00000100:00100000:1.0:1782361994.901763:0:3299:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:0.0:1782361994.901824:0:34999:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985151872
00000100:00100000:0.0:1782361994.901849:0:34999:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985151872
00000100:00100000:0.0:1782361994.901906:0:34999:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 49
00000100:00100000:0.0:1782361994.901916:0:34999:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:31017:x1868940985151872:12345-192.168.202.24@tcp:101:grep.0
00010000:00010000:0.0:1782361994.901937:0:34999:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START
00010000:00010000:0.0:1782361994.901966:0:34999:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x57a18de9e1bb32c3 expref: -99 pid: 34999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902039:0:34999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902052:0:34999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902063:0:34999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902089:0:34999:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902095:0:34999:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902101:0:34999:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902344:0:34999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902353:0:34999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902359:0:34999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902365:0:34999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055ae400 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.902369:0:34999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902377:0:34999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902388:0:34999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.902391:0:34999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.902395:0:34999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902401:0:34999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae400/0x57e58d5a90c7f178 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902419:0:34999:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902425:0:34999:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902431:0:34999:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902436:0:34999:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff95e4055af800 already unused, calling callback (ffffffffc20ec4f0)
00010000:00010000:0.0:1782361994.902439:0:34999:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902444:0:34999:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902452:0:34999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xd0bf2004 (ffff95e509f61900)
00010000:00010000:0.0:1782361994.902454:0:34999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:0.0:1782361994.902457:0:34999:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902462:0:34999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055af800/0x57e58d5a90c7f17f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xd0bf2004 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 34999 initiator: MDT0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902492:0:34999:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f171 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32c3 expref: 63 pid: 34999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902501:0:34999:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff95e408d27200)
00010000:00010000:0.0:1782361994.902503:0:34999:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00010000:0.0:1782361994.902514:0:34999:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff95e4055ae000/0x57e58d5a90c7f171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.24@tcp remote: 0x57a18de9e1bb32c3 expref: 63 pid: 34999 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0
00010000:00010000:0.0:1782361994.902524:0:34999:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff95e4055ae000, rc 0)
00000100:00100000:0.0:1782361994.902580:0:34999:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405c8bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:31017:x1868940985151872:12345-192.168.202.24@tcp:101:grep.0 Request processed in 664us (834us total) trans 0 rc 301/301
00000100:00100000:0.0:1782361994.902587:0:34999:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 49
00000100:00100000:1.0:1782361995.288977:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361995.289048:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361995.289070:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:1.0:1782361995.289094:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.24@tcp (source: 12345-192.168.202.24@tcp)
00000100:00100000:3.0:1782361995.289155:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985152256
00000100:00100000:3.0:1782361995.289165:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985152256
00000100:00100000:3.0:1782361995.289219:0:6590:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985152384
00000100:00100000:3.0:1782361995.289222:0:6590:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985152384
00000100:00100000:3.0:1782361995.289245:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 502
00000100:00100000:3.0:1782361995.289255:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985152256:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:3.0:1782361995.289319:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405c8b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985152256:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 65us (269us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361995.289326:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 502
00000100:00100000:3.0:1782361995.289341:0:6590:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 503
00000100:00100000:3.0:1782361995.289348:0:6590:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985152384:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:3.0:1782361995.289372:0:6590:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405c8a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+20:2364:x1868940985152384:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 24us (277us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361995.289377:0:6590:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 503
00000100:00100000:3.0:1782361995.289487:0:34976:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985152128
00000100:00100000:3.0:1782361995.289499:0:34976:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985152128
00000100:00100000:3.0:1782361995.289528:0:34976:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 108
00000100:00100000:3.0:1782361995.289536:0:34976:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e405c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2364:x1868940985152128:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:3.0:1782361995.289564:0:34976:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e405c8ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f4cf112e-56b0-4499-aacf-a956cfcc6c06+62:2364:x1868940985152128:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 29us (493us total) trans 0 rc 0/0
00000100:00100000:3.0:1782361995.289570:0:34976:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 108
00000100:00100000:0.0:1782361995.294102:0:34971:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1868940985152000
00000100:00100000:0.0:1782361995.294116:0:34971:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1868940985152000
00000100:00100000:0.0:1782361995.294339:0:34971:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.24@tcp, seq: 131
00000100:00100000:0.0:1782361995.294351:0:34971:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff95e4064fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:000ace06-2339-4888-a9a0-3d996f881553+10:2364:x1868940985152000:12345-192.168.202.24@tcp:400:kworker.0
00000100:00100000:0.0:1782361995.294483:0:34971:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff95e4064fac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:000ace06-2339-4888-a9a0-3d996f881553+10:2364:x1868940985152000:12345-192.168.202.24@tcp:400:kworker.0 Request processed in 134us (5513us total) trans 0 rc 0/0
00000100:00100000:0.0:1782361995.294491:0:34971:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.24@tcp, seq: 131
00000001:00080000:3.0:1782361995.405665:0:34981:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 68719476773 is committed
00000001:00100000:3.0:1782361995.405872:0:34981:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f4cf112e-56b0-4499-aacf-a956cfcc6c06
00000001:02000400:1.0:1782361995.594248:0:35756:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: replay-single test_5: @@@@@@ FAIL: f5.replay-single-19
00010000:00010000:1.0:1782361995.823330:0:5779:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
Debug log: 11312 lines, 11312 kept, 0 dropped, 0 bad.